Facebook Unveiled It’s AI System Behind The New Shopping Experiences

Recently, the researchers at Facebook AI announced that they have built and deployed a universal Computer Vision system designed for shopping known as GrokNet. The social media giant unveiled the approaches for building an accurate image product recognition system, GrokNet. It is a unified computer vision model that incorporates a diverse set of 83 loss functions, optimising jointly for accurate product recognition and various classification tasks over 7 commerce datasets.

The AI-powered shopping systems is said to leverage state-of-the-art image recognition models to improve the way people buy, sell, and discover items. In a blog post, the researchers said, “Our long-term vision is to build and develop an all-in-one AI real-time lifestyle assistant that can search and rank billions of products accurately while personalising to individuals’ tastes. That same system would make online shopping just as social as shopping with friends in real life.”

They added, “ Going one step further, it would advance visual search to make your real-world environment shoppable. If you see something you like (clothing, furniture, electronics, etc.), you could snap a photo of it and the system would find that exact item, as well as several similar ones to purchase the product immediately.”

Why This New System?

Shopping is one of the challenging tasks for AI systems to tackle because the personal taste of individuals is subjective. In order to build a truly intelligent assistant, the researchers need to teach systems to understand each individual’s taste and style including the context that matters when searching for a product to fit a specific need or situation.

Facebook Marketplace plays an important role for many people across the globe to provide a platform for selling and buying products from Facebook members and businesses. Currently, the social media giant uses image classifiers to augment product descriptions with predicted attributes, categories, and search queries, thereby improving the ability to find and browse products. The image recognition system used search log interaction data to train these image classifiers with large-scale weakly-supervised data.

According to the researchers, developing the new system has made Facebook AI a step ahead of the vision to achieve a robust AI lifestyle assistant. GrokNet is a deployed image recognition system for commerce applications that leverages a multi-task learning approach to train a single computer vision trunk. This new AI system is said to achieve a 2.1x improvement in exact product match accuracy when compared to the previous state-of-the-art Facebook product recognition system.

Behind GrokNet

GrokNet is a unified computer vision model that incorporates an underlying Convolutional Neural Network (CNN) model that forms the “trunk” of the model. The system is built as a distributed PyTorch workflow on the FBLearner framework. The trunk model for GrokNet uses ResNeXt-101 32×4d. After initialisation of the weights, the system is fine-tuned on the datasets using Distributed Data-Parallel GPU training on 8-GPU hosts, across 12 hosts (96 total GPUs).

The model is trained on human annotations, user-generated tags, and noisy search engine interaction data. According to the researchers, the final trained system analyses images to predict object category, home attributes, fashion attributes, vehicle attributes, search queries and image embedding.

For this model, the researchers combined 7 different datasets with wide-ranging label semantics and image statistics, where the combined dataset contains 89 million public images from Facebook Marketplace, and diverse image statistics include user photos of Marketplace products for sale. The model is trained on both human-provided annotations and weak signals.

Wrapping Up

According to the researchers, one of the goals of this project was to solve a large number of computer vision tasks with a single model, by training on both existing datasets as well as many new ones.

The researchers have already used this system to launch automatically populated listing details in Marketplace seller listings. According to them, GrokNet will play an important role in making virtually any photo shoppable across apps on Facebook and could be used to help customers find what they are looking for, receive personalised suggestions, and much more.

 

Original post: https://analyticsindiamag.com/facebook-unveiled-its-ai-system-behind-the-new-shopping-experiences/

104 comentários em “Facebook Unveiled It’s AI System Behind The New Shopping Experiences

  1. I’m really loving the theme/design of your web site.
    Do you ever run into any internet browser compatibility issues?
    A number of my blog audience have complained about my website not operating correctly in Explorer
    but looks great in Opera. Do you have any suggestions to help fix this
    issue?

  2. I am the proprietor of JustCBD label (justcbdstore.com) and I am currently looking to broaden my wholesale side of company. I really hope that someone at targetdomain can help me 🙂 I thought that the most suitable way to do this would be to reach out to vape shops and cbd retailers. I was really hoping if anybody at all could suggest a reputable site where I can buy Vape Shop Marketing Lead List I am currently checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable solution and would appreciate any assistance on this. Or would it be much simpler for me to scrape my own leads? Ideas?

  3. I am the co-founder of JustCBD Store company (justcbdstore.com) and I am currently aiming to develop my wholesale side of company. I really hope that anybody at targetdomain give me some advice . I considered that the most ideal way to do this would be to reach out to vape shops and cbd stores. I was hoping if someone could suggest a reliable site where I can get Vape Shop B2B Email Marketing List I am presently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the very best solution and would appreciate any guidance on this. Or would it be simpler for me to scrape my own leads? Ideas?

  4. Can I simply just say what a relief to discover someone that truly understands what they are talking about on the net. You definitely know how to bring an issue to light and make it important. More and more people ought to look at this and understand this side of your story. I was surprised that you aren’t more popular since you definitely have the gift.

  5. An interesting discussion is definitely worth comment. I believe that you should write more on this issue, it may not be a taboo subject but usually folks don’t talk about these issues. To the next! All the best!!

  6. A fascinating discussion is worth comment. I believe that you should publish more about this subject matter, it might not be a taboo subject but typically people do not speak about such subjects. To the next! Cheers!!

  7. After looking over a few of the blog posts on your web page, I honestly appreciate your way of blogging. I saved it to my bookmark webpage list and will be checking back in the near future. Please visit my web site too and let me know how you feel.

  8. Aw, this was an extremely good post. Taking a few minutes and actual effort to produce a superb article… but what can I say… I put things off a whole lot and never manage to get nearly anything done.

  9. The very next time I read a blog, Hopefully it won’t disappoint me just as much as this one. I mean, Yes, it was my choice to read, however I actually thought you would have something interesting to talk about. All I hear is a bunch of complaining about something you can fix if you were not too busy looking for attention.

  10. The next time I read a blog, I hope that it doesn’t disappoint me just as much as this particular one. I mean, I know it was my choice to read through, however I actually believed you’d have something useful to say. All I hear is a bunch of complaining about something that you could fix if you were not too busy looking for attention.

  11. Spot on with this write-up, I really believe this website needs far more attention. I’ll probably be back again to read through more, thanks for the advice!

  12. An interesting discussion is definitely worth comment. I do believe that you should write more on this topic, it might not be a taboo matter but usually people don’t speak about these issues. To the next! All the best!!

  13. Oh my goodness! Awesome article dude! Thank you, However I am having troubles with your RSS. I don’t know why I am unable to join it. Is there anyone else getting the same RSS issues? Anyone that knows the answer can you kindly respond? Thanks!!

  14. Hello there! This article could not be written any better! Looking at this post reminds me of my previous roommate! He always kept preaching about this. I will forward this information to him. Pretty sure he will have a good read. Thank you for sharing!

  15. The next time I read a blog, I hope that it doesn’t fail me as much as this one. I mean, Yes, it was my choice to read through, but I truly thought you would have something useful to say. All I hear is a bunch of crying about something you could fix if you were not too busy looking for attention.

  16. An interesting discussion is definitely worth comment. I think that you should write more on this issue, it might not be a taboo subject but typically people don’t speak about such topics. To the next! Kind regards!!

  17. I’m excited to uncover this website. I need to to thank you for ones time for this wonderful read!! I definitely appreciated every part of it and i also have you book-marked to look at new stuff on your site.

  18. You have made some good points there. I looked on the net for more information about the issue and found most individuals will go along with your views on this website.

  19. I must thank you for the efforts you have put in penning this site. I really hope to view the same high-grade content by you later on as well. In truth, your creative writing abilities has motivated me to get my own, personal site now 😉

  20. I really love your site.. Excellent colors & theme. Did you create this site yourself? Please reply back as I’m hoping to create my own website and would love to know where you got this from or exactly what the theme is named. Thanks!

  21. An intriguing discussion is definitely worth comment. I think that you need to publish more about this subject matter, it may not be a taboo matter but typically folks don’t talk about such topics. To the next! Best wishes!!

  22. The very next time I read a blog, I hope that it doesn’t disappoint me just as much as this particular one. After all, Yes, it was my choice to read through, nonetheless I actually believed you’d have something helpful to say. All I hear is a bunch of crying about something you can fix if you were not too busy looking for attention.

  23. I have to thank you for the efforts you have put in writing this website. I’m hoping to view the same high-grade blog posts by you in the future as well. In truth, your creative writing abilities has motivated me to get my own blog now 😉

  24. After looking over a handful of the articles on your blog, I really appreciate your way of writing a blog. I added it to my bookmark site list and will be checking back in the near future. Please visit my web site too and tell me your opinion.

  25. Spot on with this write-up, I truly think this web site needs a great deal more attention. I’ll probably be back again to read through more, thanks for the info!

  26. Have you ever thought about adding a little bit more than just your articles?
    I mean, what you say is valuable and everything.

    But just imagine if you added some great pictures or video clips to give your posts more,
    “pop”! Your content is excellent but with pics and video clips, this website
    could undeniably be one of the greatest in its field.

    Terrific blog!

  27. Oh my goodness! Incredible article dude! Thank you, However I am going through problems with your RSS. I don’t know why I cannot join it. Is there anybody else getting the same RSS problems? Anyone who knows the solution will you kindly respond? Thanks!!

  28. An outstanding share! I have just forwarded this onto a coworker who has been doing a little research on this. And he in fact ordered me breakfast simply because I stumbled upon it for him… lol. So allow me to reword this…. Thanks for the meal!! But yeah, thanx for spending some time to discuss this matter here on your web page.

  29. Good day! I could have sworn I’ve visited this web site before but after browsing through many of the articles I realized it’s new to me. Regardless, I’m definitely delighted I stumbled upon it and I’ll be bookmarking it and checking back regularly!

  30. A motivating discussion is definitely worth comment. There’s no doubt that that you ought to publish more about this issue, it may not be a taboo subject but generally people do not talk about such issues. To the next! Kind regards!!

  31. Howdy! I simply would like to give you a big thumbs up for your excellent info you have got right here on this post. I will be coming back to your site for more soon.

  32. After looking into a few of the articles on your blog, I seriously appreciate your technique of writing a blog. I added it to my bookmark site list and will be checking back soon. Please visit my website too and tell me what you think.

  33. You are so awesome! I don’t believe I have read through anything like this before. So wonderful to find another person with some genuine thoughts on this subject matter. Really.. thank you for starting this up. This website is one thing that’s needed on the web, someone with a bit of originality!

  34. Having read this I thought it was rather enlightening. I appreciate you taking the time and effort to put this short article together. I once again find myself spending a lot of time both reading and commenting. But so what, it was still worth it!

  35. An intriguing discussion is worth comment. I think that you should write more on this subject matter, it might not be a taboo matter but generally people don’t talk about such subjects. To the next! Best wishes!!

  36. I’m very happy to find this web site. I need to to thank you for your time for this particularly fantastic read!! I definitely enjoyed every little bit of it and i also have you book-marked to look at new things in your web site.

  37. A fascinating discussion is worth comment. I do think that you ought to publish more on this subject, it might not be a taboo matter but generally people do not speak about such topics. To the next! Many thanks!!

  38. After looking into a handful of the blog posts on your website, I really appreciate your way of blogging. I bookmarked it to my bookmark website list and will be checking back in the near future. Take a look at my web site too and let me know your opinion.

  39. I must thank you for the efforts you’ve put in penning this website. I’m hoping to check out the same high-grade content from you later on as well. In truth, your creative writing abilities has motivated me to get my own site now 😉

  40. After I originally left a comment I appear to have clicked the -Notify me when new comments are added- checkbox and from now on every time a comment is added I recieve 4 emails with the exact same comment. Perhaps there is a means you are able to remove me from that service? Thanks a lot!

  41. The very next time I read a blog, Hopefully it does not fail me just as much as this particular one. I mean, I know it was my choice to read through, but I actually thought you would have something interesting to talk about. All I hear is a bunch of moaning about something you could possibly fix if you weren’t too busy searching for attention.

  42. A fascinating discussion is definitely worth comment. I do believe that you ought to publish more about this subject, it may not be a taboo matter but generally people do not speak about these subjects. To the next! All the best!!

  43. Greetings from Carolina! I’m bored to tears at work so I decided to browse your blog on my iphone during lunch break. I enjoy the knowledge you provide here and can’t wait to take a look when I get home. I’m amazed at how fast your blog loaded on my mobile .. I’m not even using WIFI, just 3G .. Anyhow, very good blog!|

  44. After looking into a number of the blog articles on your web site, I truly appreciate your technique of blogging. I bookmarked it to my bookmark website list and will be checking back soon. Please visit my web site too and let me know how you feel.

  45. Aw, this was a really good post. Taking a few minutes and actual effort to produce a very good article… but what can I say… I hesitate a lot and never manage to get nearly anything done.

  46. After looking at a few of the blog articles on your website, I honestly like your technique of blogging. I saved as a favorite it to my bookmark webpage list and will be checking back in the near future. Please visit my website too and tell me your opinion.

  47. After I initially left a comment I seem to have clicked on the -Notify me when new comments are added- checkbox and now every time a comment is added I get four emails with the same comment. Perhaps there is a way you can remove me from that service? Thanks!

  48. Hi, I do believe this is an excellent website. I stumbledupon it 😉 I will return yet again since i have book marked it. Money and freedom is the greatest way to change, may you be rich and continue to guide other people.

  49. Aw, this was an extremely nice post. Taking the time and actual effort to produce a very good article… but what can I say… I put things off a lot and don’t manage to get anything done.

  50. Woah! I’m really digging the template/theme of this blog. It’s simple, yet effective. A lot of times it’s very difficult to get that “perfect balance” between superb usability and visual appearance. I must say that you’ve done a superb job with this. Additionally, the blog loads extremely quick for me on Opera. Superb Blog!|

  51. An outstanding share! I’ve just forwarded this onto a colleague who has been conducting a little research on this. And he in fact ordered me lunch because I found it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanks for spending some time to talk about this topic here on your web site.

  52. Hello there! This post could not be written any better! Going through this article reminds me of my previous roommate! He always kept talking about this. I most certainly will send this information to him. Fairly certain he’s going to have a very good read. Thank you for sharing!

  53. Hi there, i read your blog from time to time and i own a similar one and i was just wondering if you get a lot of spam responses? If so how do you protect against it, any plugin or anything you can advise? I get so much lately it’s driving me crazy so any support is very much appreciated.|

  54. The very next time I read a blog, Hopefully it doesn’t disappoint me just as much as this one. After all, Yes, it was my choice to read, but I actually thought you’d have something interesting to talk about. All I hear is a bunch of crying about something you could fix if you weren’t too busy looking for attention.

  55. You are so cool! I don’t believe I’ve truly read anything like that before. So wonderful to find somebody with some genuine thoughts on this subject matter. Seriously.. many thanks for starting this up. This site is one thing that is needed on the internet, someone with a little originality!

  56. I blog frequently and I genuinely appreciate your information. This great article has truly peaked my interest. I am going to take a note of your blog and keep checking for new information about once a week. I opted in for your Feed too.

  57. Hello there! I could have sworn I’ve visited this web site before but after going through many of the articles I realized it’s new to me. Anyways, I’m certainly happy I came across it and I’ll be book-marking it and checking back regularly!

  58. Nice post. I learn something totally new and challenging on sites I stumbleupon on a daily basis. It’s always helpful to read content from other authors and use something from other websites.

Leave a Reply

Your email address will not be published. Required fields are marked *