Two separate studies, one by UK-based artificial intelligence lab DeepMind and the other by researchers in Germany and Greece, display the fascinating relations between AI and neuroscience.
As most scientists will tell you, we are still decades away from building artificial general intelligence, machines that can solve problems as efficiently as humans. On the path to creating general AI, the human brain, arguably the most complex creation of nature, is the best guide we have.
Advances in neuroscience, the study of nervous systems, provide interesting insights into how the brain works, a key component for developing better AI systems. Reciprocally, the development of better AI systems can help drive neuroscience forward and further unlock the secrets of the brain.
For instance, convolutional neural networks (CNN), one of the key contributors to recent advances in artificial intelligence, are largely inspired by neuroscience research on the visual cortex. On the other hand, neuroscientist leverage AI algorithms to study millions of signals from the brain and find patterns that would have gone. The two fields are closely related and their synergies produce very interesting results.
Recent discoveries in neuroscience show what we’re doing right in AI, and what we’ve got wrong.
DeepMind’s AI research shows connections between dopamine and reinforcement learning
A recent study by researchers at DeepMind prove that AI research (at least part of it) is headed in the right direction.
Thanks to neuroscience, we know that one of the basic mechanisms through which humans and animals learn is rewards and punishments. Positive outcomes encourage us to repeat certain tasks (do sports, study for exams, etc.) while negative results detract us from repeating mistakes (touch a hot stove).
The reward and punishment mechanism is best known by the experiments of Russian physiologist Ivan Pavlov, who trained dogs to expect food whenever they hear a bell. We also know that dopamine, a neurotransmitter chemical produced in the midbrain, plays a great role in regulating the reward functions of the brain.
Reinforcement learning, one of the hottest areas of artificial intelligence research, has been roughly fashioned after the reward/punishment mechanism of the brain. In RL, an AI agent is set to explore a problem space and try different actions. For each action it performs, the agent receives a numerical reward or penalty. Through massive trial and error and by examining the outcome of its actions, the AI agent develops a mathematical model optimized to maximize rewards and avoiding penalties. (In reality, it’s a bit more complicated and involves dealing with exploration and exploitation and other challenges.)
More recently, AI researchers have been focusing on distributional reinforcement learning to create better models. The basic idea behind distributional RL is to use multiple factors to predict rewards and punishments in a spectrum of optimistic and pessimistic ways. Distributional reinforcement learning has been pivotal in creating AI agents that are more resilient to changes in their environments.
The new research, jointly done by Harvard University and DeepMind and published in Nature last week, has found properties in the brain of mice that are very similar to those of distributional reinforcement learning. The AI researchers measured dopamine firing rates in the brain to examine the variance in reward prediction rates of biological neurons.
Interestingly, the same optimism and pessimism mechanism that AI scientists had programmed in distributional reinforcement learning models was found in the nervous system of mice. “In summary, we found that dopamine neurons in the brain were each tuned to different levels of pessimism or optimism,” DeepMind’s researchers wrote in a blog post published on the AI lab’s website. “In artificial reinforcement learning systems, this diverse tuning creates a richer training signal that greatly speeds learning in neural networks, and we speculate that the brain might use it for the same reason.”
What makes this finding special is that while AI research usually takes inspiration from neuroscience discovery, in this case, neuroscience research has validated AI discoveries. “It gives us increased confidence that AI research is on the right track, since this algorithm is already being used in the most intelligent entity we’re aware of: the brain,” the researchers write.
It will also lay the groundwork for further research in neuroscience, which will, in turn, benefit the field of AI.
Neurons are not as dumb as we think
While DeepMind’s new findings confirmed the work done in AI reinforcement learning research, another research by scientists in Berlin, this time published in Science in early January, proves that some of the fundamental assumptions we made about the brain are quite wrong.
The general belief about the structure of the brain is that neurons, the basic component of the nervous system are simple integrators that calculate the weighted sum of their inputs. Artificial neural networks, a popular type of machine learning algorithm, have been designed based on this belief.
Alone, an artificial neuron performs a very simple operation. It takes several inputs, multiplies them by predefined weights, sums them and runs them through an activation function. But when connecting thousands and millions (and billions) of artificial neurons in multiple layers, you obtain a very flexible mathematical function that can solve complex problems such as detecting objects in images or transcribing speech.
Multi-layered networks of artificial neurons, generally called deep neural networks, are the main drive behind the deep learning revolution in the past decade.
But the general perception of biological neurons being “dumb” calculators of basic math is overly simplistic. The recent findings of the German researchers, which were later corroborated by neuroscientists at a lab in Greece, proved that single neurons can perform XOR operations, a premise that was rejected by AI pioneers such as Marvin Minsky and Seymour Papert.
While not all neurons have this capability, the implications of the finding are significant. For instance, it might mean that a single neuron might contain a deep network within itself. Konrad Kording, a computational neuroscientist at the University of Pennsylvania who was not involved in the research, told Quanta Magazine that the finding could mean “a single neuron may be able to compute truly complex functions. For example, it might, by itself, be able to recognize an object.”
What does this mean for artificial intelligence research? At the very least, it means that we need to rethink our modeling of neurons. It might spur research in new artificial neuron structures and networks with different types of neurons. Maybe it might help free us from the trap of having to build extremely large neural networks and datasets to solve very simple problems.
“The whole game—to come up with how you get smart cognition out of dumb neurons—might be wrong,” cognitive scientist Gary Marcus, who also spoke to Quanta, said in this regard.
Original post: https://bdtechtalks.com/2020/01/20/neuroscience-artificial-intelligence-synergies/
I’m the owner of JustCBD Store label (justcbdstore.com) and am looking to grow my wholesale side of company. I am hoping someone at targetdomain can help me ! I thought that the most ideal way to do this would be to reach out to vape companies and cbd retailers. I was really hoping if anybody at all could recommend a reputable web site where I can purchase Vape Shop Business Data I am currently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable option and would appreciate any advice on this. Or would it be easier for me to scrape my own leads? Ideas?
Very good article! We are linking to this great article on our website. Keep up the great writing.
Excellent blog post. I definitely appreciate this website. Keep it up!
Greetings! Very useful advice in this particular article! It is the little changes which will make the greatest changes. Thanks for sharing!
I blog often and I truly appreciate your content. This great article has truly peaked my interest. I will bookmark your website and keep checking for new information about once a week. I subscribed to your Feed as well.
It’s hard to come by experienced people in this particular topic, but you sound like you know what you’re talking about! Thanks
Great site you have got here.. It’s hard to find high-quality writing like yours these days. I truly appreciate individuals like you! Take care!!
Have you ever considered about adding a little bit more than just
your articles? I mean, what you say is fundamental and all.
But think about if you added some great photos or videos
to give your posts more, “pop”! Your content is excellent but with images and videos, this site could certainly
be one of the best in its niche. Awesome blog! adreamoftrains hosting services
Howdy! This post couldn’t be written much better! Looking at this article reminds me of my previous roommate! He continually kept preaching about this. I most certainly will forward this information to him. Pretty sure he will have a great read. I appreciate you for sharing!
You need to be a part of a contest for one of the greatest sites on the internet. I most certainly will highly recommend this site!
Achieving your fitness goal does not have to require a certified personal trainer or an expensive gym memberships, especially when you have the budget and the space to consider practically every workout machine in the market.
Everything is very open with a very clear description of the challenges. It was truly informative. Your site is extremely helpful. Thank you for sharing!
This blog was… how do I say it? Relevant!! Finally I have found something that helped me. Appreciate it!
Pretty! This was a really wonderful post. Thanks for providing this info.
I like it when individuals get together and share opinions. Great site, stick with it!
Greetings! Very useful advice in this particular post! It’s the little changes which will make the greatest changes. Thanks for sharing!
I wanted to thank you for this great read!! I absolutely enjoyed every bit of it. I have you book-marked to look at new stuff you post…
Nice post. I learn something new and challenging on sites I stumbleupon everyday. It will always be interesting to read through articles from other authors and use a little something from their web sites.
I could not resist commenting. Well written!
It’s hard to come by experienced people for this topic, however, you seem like you know what you’re talking about! Thanks
You need to take part in a contest for one of the greatest sites on the web. I will recommend this site!
An impressive share! I’ve just forwarded this onto a coworker who had been conducting a little research on this. And he in fact ordered me lunch due to the fact that I found it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanks for spending some time to talk about this subject here on your web site.
After going over a handful of the articles on your web page, I seriously like your technique of writing a blog. I saved it to my bookmark site list and will be checking back soon. Please visit my website too and let me know what you think.
May I just say what a comfort to uncover somebody that genuinely knows what they’re discussing on the net. You definitely realize how to bring an issue to light and make it important. More and more people have to look at this and understand this side of your story. I was surprised you’re not more popular since you most certainly possess the gift.
Can I simply just say what a comfort to find someone that genuinely understands what they are talking about over the internet. You actually know how to bring a problem to light and make it important. A lot more people need to check this out and understand this side of the story. I was surprised you are not more popular given that you definitely have the gift.
Right here is the perfect blog for anyone who wishes to find out about this topic. You understand so much its almost tough to argue with you (not that I personally would want to…HaHa). You definitely put a brand new spin on a topic that’s been written about for decades. Great stuff, just great!
This blog was… how do you say it? Relevant!! Finally I have found something which helped me. Appreciate it!
That is a great tip particularly to those fresh to the blogosphere. Simple but very accurate information… Thank you for sharing this one. A must read post!
Way cool! Some very valid points! I appreciate you penning this post plus the rest of the website is very good.
Hello there! I could have sworn I’ve been to this web site before but after going through some of the posts I realized it’s new to me.
Regardless, I’m definitely pleased I came across
it and I’ll be bookmarking it and checking back frequently!