What are Important AI & Machine Learning Trends for 2020?

Companies ranging from high tech startups to global multinationals see artificial intelligence as a key competitive advantage in an increasingly competitive and technical market.

But, the AI industry moves so quickly that it’s often hard to follow the latest research breakthroughs and achievements, and even harder to apply scientific results to achieve business outcomes.

To help you develop a robust AI strategy for your business in 2020, I’ve summarized the latest trends across different research areas, including natural language processing, conversational AI, computer vision, and reinforcement learning. I’ve also included external education you can follow to further your expertise.

Natural Language Processing

In 2018, pre-trained language models pushed the limits of natural language understanding and generation. These also dominated NLP progress last year.

If you’re new to NLP developments, pre-trained language models have made practical applications of NLP significantly cheaper, faster, and easier as they allow to pre-train an NLP model on one large dataset and then quickly fine-tune it to adapt to other NLP tasks.

Teams from top research institutions and tech companies explored ways to make state-of-the-art language models even more sophisticated. Many improvements were driven by massive boosts in computing capacities, but many research groups also found ingenious ways to lighten models while maintaining high performance.

Thus, current research trends are as follows:

  • The new NLP paradigm is “pre-training + fine-tuning”. Transfer learning has dominated NLP research over the last two years. ULMFiT, CoVe, ELMo, OpenAI GPT, BERT, OpenAI GPT-2, XLNet, RoBERTa, ALBERT – this is a non-exhaustive list of important pre-trained language models introduced recently. Even though transfer learning has definitely pushed NLP to the next level, it is often criticized for requiring huge computational costs and big annotated datasets.
  • Linguistics and knowledge are likely to advance the performance of NLP models. The experts believe that linguistics can boost deep learning by improving the interpretability of the data-driven approach. Leveraging the context and human knowledge can further improve the performance of NLP systems.
  • Neural machine translation is demonstrating visible progress. Simultaneous machine translation is already performing at the level where it can be applied in the real world. The recent research breakthroughs seek to further improve the quality of translation by optimizing neural network architectures, leveraging visual context, and introducing novel approaches to unsupervised and semi-supervised machine translation.

Conversational AI

Conversational AI is becoming an integral part of business practice across industries. More companies are adopting the advantages chatbots bring to customer service, sales, and marketing.

Even though chatbots are becoming a “must-have” asset for leading businesses, their performance is still very far from human. Researchers from major research institutions and tech leaders have explored ways to boost the performance of dialog systems:

  • Dialog systems are improving at tracking long-term aspects of a conversation. The goal of many research papers presented over the last year was to improve the system’s ability to understand complex relationships introduced during the conversation by better leveraging the conversation history and context.
  • Many research teams are addressing the diversity of machine-generated responses. Currently, real-world chatbots mostly generate boring and repetitive responses. Last year, several good research papers were introduced aiming at generating diverse and yet relevant responses.
  • Emotion recognition is seen as an important feature for open-domain chatbots. Therefore, researchers are investigating the best ways to incorporate empathy into dialog systems. The achievements in this research area are still modest but considerable progress in emotion recognition can significantly boost the performance and popularity of social bots and also increase the use of chatbots in psychotherapy.

Computer Vision

During the last few years, computer vision (CV) systems have revolutionized whole industries and business functions with successful applications in healthcare, security, transportation, retail, banking, agriculture, and more.

Recently introduced architectures and approaches like EfficientNet and SinGAN further improve the perceptive and generative capacities of visual systems.

The trending research topics in computer vision are the following:

  • 3D is currently one of the leading research areas in CV. This year, we saw several interesting research papers aiming at reconstructing our 3D world from its 2D projections. The Google Research team introduced a novel approach to generating depth maps of entire natural scenes. The Facebook AI team suggested an interesting solution for 3D object detection in point clouds.
  • The popularity of unsupervised learning methods is growing. For example, a research team from Stanford University introduced a promising Local Aggregation approach to object detection and recognition with unsupervised learning. In another great paper, nominated for the ICCV 2019 Best Paper Award, unsupervised learning was used to compute correspondences across 3D shapes.
  • Computer vision research is being successfully combined with NLP. The latest research advances enable robust change captioning between two images in natural language, vision-language navigation in 3D environments, and learning hierarchical vision-language representation for better image caption retrieval and visual grounding.

Reinforcement Learning

Reinforcement learning (RL) continues to be less valuable for business applications than supervised learning, and even unsupervised learning. It is successfully applied only in areas where huge amounts of simulated data can be generated, like robotics and games.

However, many experts recognize RL as a promising path towards Artificial General Intelligence (AGI), or true intelligence. Thus, research teams from top institutions and tech leaders are seeking ways to make RL algorithms more sample-efficient and stable. The trending research topics in reinforcement learning include:

  • Multi-agent reinforcement learning (MARL) is rapidly advancing. The OpenAI team has recently demonstrated how the agents in a simulated hide-and-seek environment were able to build strategies that researchers did not know their environment supported. Another great paper received an Honorable Mention at ICML 2019 for investigating how multiple agents influence each other if provided with the corresponding motivation.
  • Off-policy evaluation and off-policy learning are recognized as very important for future RL applications. The recent breakthroughs in this research area include new solutions for batch policy learning under multiple constraintscombining parametric and non-parametric models, and introducing a novel class of off-policy algorithms to force an agent towards acting close to on-policy.
  • Exploration is an area where serious progress can be achieved. The papers presented at ICML 2019 introduced new efficient exploration methods with distributional RLmaximum entropy exploration, and a security condition to deal with the bridge effect in reinforcement learning.

This is a quick and high-level overview of new AI & machine learning research trends across the most popular subtopics of NLP, conversational AI, computer vision, and reinforcement learning, many of which have implications for business.

Many more breakthroughs in applied AI are expected in 2020 that will build on notable technical advancements in machine learning achieved in 2019.

Get the best of Forbes to your inbox with the latest insights from experts across the globe.

Follow me on Twitter. Check out my website.

Mariya Yao

Mariya Yao is co-author of the bestselling book, Applied AI: A Handbook For Business Leaders, and Editor-In-Chief of TOPBOTS, an AI educational resource.

Original post: https://www.forbes.com/sites/mariyayao/2020/01/22/what-are–important-ai–machine-learning-trends-for-2020/

32 comentários em “What are Important AI & Machine Learning Trends for 2020?

  1. I am the proprietor of JustCBD company (justcbdstore.com) and I’m presently trying to broaden my wholesale side of company. I really hope that someone at targetdomain give me some advice 🙂 I considered that the very best way to accomplish this would be to connect to vape companies and cbd stores. I was hoping if anybody at all could suggest a reputable web site where I can purchase Vape Shop B2B Companies I am already checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the most suitable solution and would appreciate any guidance on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  2. I am the proprietor of JustCBD Store company (justcbdstore.com) and am aiming to grow my wholesale side of business. I really hope that anybody at targetdomain is able to provide some guidance . I considered that the very best way to accomplish this would be to connect to vape stores and cbd retail stores. I was hoping if anybody could recommend a reputable web site where I can buy CBD Shops Business Leads I am currently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the very best option and would appreciate any assistance on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  3. I blog often and I seriously thank you for your content. Your article has really peaked my interest. I am going to bookmark your website and keep checking for new information about once per week. I opted in for your Feed as well.

  4. After checking out a few of the blog articles on your site, I really appreciate your way of writing a blog. I saved it to my bookmark webpage list and will be checking back soon. Take a look at my web site as well and let me know your opinion.

  5. Greetings, I believe your site might be having browser compatibility issues. Whenever I take a look at your blog in Safari, it looks fine but when opening in I.E., it has some overlapping issues. I just wanted to give you a quick heads up! Besides that, fantastic website!

  6. I’m curious to find out what blog platform you happen to be utilizing?
    I’m having some minor security problems with my latest blog and I would like to find something more safe.
    Do you have any suggestions?

  7. Your style is really unique in comparison to other people I’ve read stuff from. Many thanks for posting when you have the opportunity, Guess I’ll just bookmark this web site.

  8. May I just say what a relief to discover an individual who truly understands what they’re discussing online. You actually know how to bring a problem to light and make it important. A lot more people ought to look at this and understand this side of your story. It’s surprising you aren’t more popular since you most certainly possess the gift.

  9. I blog frequently and I really appreciate your content. Your article has really peaked my interest. I am going to book mark your site and keep checking for new details about once a week. I opted in for your RSS feed as well.

  10. Hi, I do believe this is an excellent website. I stumbledupon it 😉 I am going to come back yet again since i have saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to help others.

  11. Achieving your fitness goals does not have to require a certified personal trainer or an expensive gym membership, it is not hard to exercise at home. It’s easy to go down a training and fitness rabbit hole, however, when you’re looking for the best home exercise equipment to outfit your personal home gym.

  12. May I simply say what a comfort to discover someone who really understands what they are talking about on the net. You certainly know how to bring a problem to light and make it important. A lot more people ought to check this out and understand this side of the story. I was surprised you are not more popular because you certainly have the gift.

  13. Can I just say what a relief to uncover someone that actually knows what they’re talking about on the net. You actually know how to bring an issue to light and make it important. A lot more people must read this and understand this side of the story. I was surprised that you’re not more popular since you most certainly possess the gift.

  14. An interesting discussion is worth comment. I do believe that you need to write more about this subject, it might not be a taboo matter but generally people don’t discuss such subjects. To the next! All the best!!

  15. Hi! I could have sworn I’ve been to your blog before but after looking at some of the articles I realized it’s new to me. Anyways, I’m certainly pleased I came across it and I’ll be book-marking it and checking back regularly!

  16. Howdy! This post couldn’t be written any better! Looking at this post reminds me of my previous roommate! He constantly kept talking about this. I will send this information to him. Pretty sure he will have a very good read. I appreciate you for sharing!

  17. Hello there! This blog post could not be written any better! Looking through this post reminds me of my previous roommate! He always kept talking about this. I will forward this article to him. Fairly certain he’s going to have a very good read. I appreciate you for sharing!

  18. Right here is the perfect webpage for anybody who hopes to find out about this topic. You understand a whole lot its almost tough to argue with you (not that I really will need to…HaHa). You certainly put a brand new spin on a topic which has been written about for a long time. Wonderful stuff, just great!

Leave a Reply

Your email address will not be published. Required fields are marked *