Artificial brains may need sleep too

No one can say whether androids will dream of electric sheep, but they will almost certainly need periods of rest that offer benefits similar to those that sleep provides to living brains, according to new research from Los Alamos National Laboratory.

“We study spiking neural networks, which are systems that learn much as living brains do,” said Los Alamos National Laboratory computer scientist Yijing Watkins. “We were fascinated by the prospect of training a neuromorphic processor in a manner analogous to how humans and other biological systems learn from their environment during childhood development.”

Watkins and her research team found that the network simulations became unstable after continuous periods of unsupervised learning. When they exposed the networks to states that are analogous to the waves that living brains experience during sleep, stability was restored. “It was as though we were giving the neural networks the equivalent of a good night’s rest,” said Watkins.

The discovery came about as the research team worked to develop neural networks that closely approximate how humans and other biological systems learn to see. The group initially struggled with stabilizing simulated neural networks undergoing unsupervised dictionary training, which involves classifying objects without having prior examples to compare them to.

“The issue of how to keep learning systems from becoming unstable really only arises when attempting to utilize biologically realistic, spiking neuromorphic processors or when trying to understand biology itself,” said Los Alamos computer scientist and study coauthor Garrett Kenyon. “The vast majority of machine learning, deep learning, and AI researchers never encounter this issue because in the very artificial systems they study they have the luxury of performing global mathematical operations that have the effect of regulating the overall dynamical gain of the system.”

The researchers characterize the decision to expose the networks to an artificial analog of sleep as nearly a last ditch effort to stabilize them. They experimented with various types of noise, roughly comparable to the static you might encounter between stations while tuning a radio. The best results came when they used waves of so-called Gaussian noise, which includes a wide range of frequencies and amplitudes. They hypothesize that the noise mimics the input received by biological neurons during slow-wave sleep. The results suggest that slow-wave sleep may act, in part, to ensure that cortical neurons maintain their stability and do not hallucinate.

The groups’ next goal is to implement their algorithm on Intel’s Loihi neuromorphic chip. They hope allowing Loihi to sleep from time to time will enable it to stably process information from a silicon retina camera in real time. If the findings confirm the need for sleep in artificial brains, we can probably expect the same to be true of androids and other intelligent machines that may come about in the future.

Watkins will be presenting the research at the Women in Computer Vision Workshop on June 14 in Seattle.

 

Original post:

112 comentários em “Artificial brains may need sleep too

  1. I all the time used to study post in news papers but now as I am
    a user of internet so from now I am using net for content, thanks to web.

  2. Hi there, I do believe your blog may be having web browser compatibility problems.

    When I take a look at your web site in Safari, it looks fine but when opening in Internet Explorer, it has some overlapping issues.
    I simply wanted to give you a quick heads up! Besides that, excellent website!

  3. Hey there! This post couldn’t be written any better! Reading through this
    post reminds me of my previous room mate! He always kept talking about this.
    I will forward this article to him. Fairly certain he will have a good read.
    Many thanks for sharing!

  4. I am curious to find out what blog platform you are using?
    I’m experiencing some small security problems with my latest website and I would like
    to find something more safeguarded. Do you have any solutions?

  5. I am the owner of JustCBD brand (justcbdstore.com) and I am currently trying to develop my wholesale side of business. I really hope that anybody at targetdomain is able to provide some guidance 🙂 I thought that the most effective way to do this would be to connect to vape companies and cbd retailers. I was hoping if anyone could suggest a dependable site where I can purchase Vape Shop B2B Database I am presently taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the best solution and would appreciate any guidance on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  6. It’s perfect time to make some plans for the long run and it is time to be happy.
    I have read this publish and if I may just I wish to counsel you few fascinating issues or
    suggestions. Maybe you could write subsequent articles regarding this
    article. I desire to read even more things about it!

  7. I am the business owner of JustCBD Store company (justcbdstore.com) and I am currently planning to broaden my wholesale side of company. It would be great if anybody at targetdomain is able to provide some guidance 🙂 I considered that the most suitable way to do this would be to connect to vape companies and cbd retailers. I was really hoping if anyone could suggest a dependable site where I can get Vape Shop Sales Leads I am already taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the most suitable option and would appreciate any advice on this. Or would it be much simpler for me to scrape my own leads? Ideas?

  8. Hi, I do think this is a great site. I stumbledupon it 😉 I will return yet again since i have book-marked it. Money and freedom is the best way to change, may you be rich and continue to help others.

  9. Your style is very unique in comparison to other people I’ve read stuff from. Thanks for posting when you have the opportunity, Guess I will just book mark this web site.

  10. Hi, I do believe this is an excellent website. I stumbledupon it 😉 I’m going to come back once again since i have book-marked it. Money and freedom is the greatest way to change, may you be rich and continue to guide others.

  11. I’d like to thank you for the efforts you have put in penning this site. I really hope to view the same high-grade content from you in the future as well. In fact, your creative writing abilities has encouraged me to get my very own blog now 😉

  12. An intriguing discussion is worth comment. I do think that you ought to write more on this issue, it
    might not be a taboo matter but generally people don’t talk about such topics.

    To the next! Best wishes!!

  13. Having read this I thought it was rather informative. I appreciate you spending some time and effort to put this informative article together. I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!

  14. Hello there, There’s no doubt that your website could possibly be having browser compatibility issues. When I look at your web site in Safari, it looks fine however, when opening in Internet Explorer, it’s got some overlapping issues. I just wanted to provide you with a quick heads up! Other than that, great website!

  15. Hi there! This post could not be written any better! Looking through this article reminds me of my previous roommate! He always kept talking about this. I will send this information to him. Pretty sure he will have a very good read. Many thanks for sharing!

  16. I was more than happy to uncover this great site. I
    want to to thank you for ones time just for this wonderful read!!
    I definitely loved every part of it and I have you saved to fav to look at new information in your blog.

  17. Good day! I could have sworn I’ve visited this blog before but after going through many of the articles I realized it’s new to me. Regardless, I’m definitely happy I discovered it and I’ll be bookmarking it and checking back often!

  18. Everything is very open with a really clear description of the challenges. It was really informative. Your site is useful. Many thanks for sharing!

  19. Hi, I do believe this is a great site. I stumbledupon it 😉 I will come back once again since I book-marked it. Money and freedom is the best way to change, may you be rich and continue to guide others.

  20. I blog often and I genuinely thank you for your content. The article has really peaked my interest. I’m going to take a note of your site and keep checking for new details about once a week. I opted in for your RSS feed as well.

  21. Oh my goodness! Impressive article dude! Thank you, However I am experiencing problems with your RSS. I don’t know the reason why I am unable to join it. Is there anybody else getting similar RSS problems? Anyone who knows the answer will you kindly respond? Thanks!!

  22. Oh my goodness! Incredible article dude! Thank you, However I am encountering problems with your RSS. I don’t understand why I am unable to subscribe to it. Is there anybody else getting the same RSS issues? Anyone that knows the answer can you kindly respond? Thanx!!

  23. An interesting discussion is worth comment. I do believe that you should write more about this subject, it might not be a taboo matter but typically folks don’t speak about such issues. To the next! All the best!!

  24. I’m impressed, I must say. Seldom do I come across a blog that’s equally educative and interesting, and let me tell you, you’ve hit the nail on the head. The issue is something that not enough folks are speaking intelligently about. I’m very happy I stumbled across this in my search for something regarding this.

  25. Hi there, I do think your web site might be having web browser compatibility issues. When I look at your website in Safari, it looks fine however when opening in IE, it’s got some overlapping issues. I merely wanted to give you a quick heads up! Besides that, wonderful website!

  26. An impressive share! I’ve just forwarded this onto a co-worker who has been doing a little research on this. And he in fact bought me dinner because I found it for him… lol. So let me reword this…. Thanks for the meal!! But yeah, thanx for spending some time to talk about this matter here on your internet site.

  27. I think that is one of the such a lot important information for me.
    And i’m happy studying your article. But should observation on few
    general issues, The website style is great, the articles is
    truly nice : D. Just right activity, cheers

  28. Hello there, I do think your site could be having browser compatibility problems. When I look at your blog in Safari, it looks fine however when opening in I.E., it has some overlapping issues. I merely wanted to provide you with a quick heads up! Besides that, great blog!

  29. Hello there! This article couldn’t be written much better! Looking at this article reminds me of my previous roommate! He constantly kept talking about this. I most certainly will send this post to him. Fairly certain he’s going to have a good read. Many thanks for sharing!

  30. I’m amazed, I have to admit. Rarely do I encounter a blog that’s equally educative and amusing, and let me tell you, you have hit the nail on the head. The issue is something which too few people are speaking intelligently about. I am very happy that I stumbled across this in my hunt for something relating to this.

  31. You are so awesome! I do not believe I’ve truly read something like this before. So nice to discover someone with a few genuine thoughts on this subject. Really.. many thanks for starting this up. This website is something that is needed on the web, someone with a bit of originality!

  32. A fascinating discussion is definitely worth comment.
    I think that you ought to write more on this issue,
    it may not be a taboo matter but typically people
    do not speak about such subjects. To the next!
    Kind regards!!

  33. It is appropriate time to make some plans for the longer term
    and it’s time to be happy. I’ve read this put up and if I could I desire to recommend
    you some interesting issues or tips. Perhaps
    you can write subsequent articles referring to this article.
    I desire to learn more issues approximately it!

  34. After looking over a number of the articles on your web site, I seriously like your technique of writing a blog. I bookmarked it to my bookmark site list and will be checking back in the near future. Take a look at my web site as well and tell me what you think.

  35. Having read this I thought it was really informative. I appreciate you finding the time and effort to put this information together. I once again find myself personally spending way too much time both reading and leaving comments. But so what, it was still worth it!

  36. An impressive share! I’ve just forwarded this onto a colleague who was conducting a little research on this. And he actually ordered me lunch due to the fact that I stumbled upon it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending time to talk about this matter here on your web page.

  37. Hi, I do believe this is a great site. I stumbledupon it 😉 I am going to return once again since i have saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to help other people.

  38. You’re so cool! I don’t believe I’ve truly read something like that before. So great to find someone with some original thoughts on this topic. Really.. thank you for starting this up. This site is one thing that is needed on the web, someone with a little originality!

  39. Nice post. I learn something new and challenging on blogs I stumbleupon on a daily basis. It’s always exciting to read through articles from other writers and use something from other web sites.

  40. I really love your website.. Excellent colors & theme. Did you make this web site yourself? Please reply back as I’m planning to create my own personal website and would like to learn where you got this from or just what the theme is named. Appreciate it!

  41. You’ve made some really good points there. I checked on the web to find out more about the issue and found most individuals will go along with your views on this site.

  42. I was extremely pleased to uncover this page. I want to to thank you for your time for this particularly wonderful read!! I definitely really liked every part of it and i also have you saved to fav to look at new things in your web site.

  43. I really love your site.. Very nice colors & theme. Did you build this amazing site yourself? Please reply back as I’m planning to create my very own site and would like to know where you got this from or what the theme is called. Kudos!

  44. Hi! I could have sworn I’ve been to your blog before but after looking at many of the posts I realized it’s new to me. Anyhow, I’m certainly pleased I came across it and I’ll be bookmarking it and checking back regularly!

  45. The very next time I read a blog, I hope that it doesn’t disappoint me just as much as this one. I mean, I know it was my choice to read through, but I really believed you would have something useful to say. All I hear is a bunch of whining about something you can fix if you were not too busy seeking attention.

  46. You’re so awesome! I do not suppose I’ve truly read through anything like this before. So great to find someone with genuine thoughts on this issue. Seriously.. thank you for starting this up. This web site is something that’s needed on the internet, someone with a bit of originality!

  47. The very next time I read a blog, I hope that it does not disappoint me as much as this particular one. After all, Yes, it was my choice to read, nonetheless I genuinely thought you would probably have something interesting to talk about. All I hear is a bunch of whining about something you could fix if you were not too busy looking for attention.

  48. Achieving your fitness goal doesn’t need a certified personal trainer or an expensive gym memberships, especially if you have the budget and the space to consider practically every workout machine on the market.

  49. Normally I don’t read post on blogs, but I wish to say that this write-up very compelled me to
    try and do it! Your writing taste has been amazed me. Thanks, very nice article.
    cheap flights 31muvXS

  50. You’re so awesome! I don’t believe I’ve read something like this before. So great to discover another person with some genuine thoughts on this issue. Seriously.. thanks for starting this up. This web site is one thing that is required on the web, someone with a bit of originality!

  51. Hi, I do believe this is a great site. I stumbledupon it 😉 I’m going to come back once again since i have book marked it. Money and freedom is the best way to change, may you be rich and continue to help other people.

  52. Aw, this was a really good post. Taking the time and actual effort to make a good article… but what can I say… I put things off a whole lot and don’t manage to get anything done.

  53. Hello there, I believe your blog could be having internet browser compatibility problems. When I take a look at your site in Safari, it looks fine but when opening in IE, it’s got some overlapping issues. I just wanted to provide you with a quick heads up! Other than that, wonderful blog!

  54. This is a really good tip particularly to those fresh to the blogosphere. Simple but very accurate information… Appreciate your sharing this one. A must read post!

  55. An outstanding share! I’ve just forwarded this onto a colleague who has been conducting a little research on this. And he in fact bought me breakfast because I discovered it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanx for spending some time to talk about this subject here on your blog.

  56. Aw, this was an incredibly good post. Taking the time and actual effort to generate a top notch article… but what can I say… I put things off a lot and never manage to get anything done.

Leave a Reply

Your email address will not be published. Required fields are marked *