Demystifying the AI Infrastructure Stack

As companies increase their investments in artificial intelligence (AI), there is growing pressure on developers and engineers to deploy AI projects more quickly and at greater scale across the enterprise.

Simply evaluating the ever-expanding universe of AI tools and services— often designed for different users and purposes—is a significant challenge in this growing and fast-moving environment.

To address this challenge, we have created the AI Infrastructure Stack, a landscape map that brings greater clarity to the AI ecosystem by charting the layers of the AI technical stack and the vendors within each layer.

At Intel Capital this helps us identify the investments we believe will have the greatest positive impact on the future of AI, but it also helps developers and engineers identify the resources they need to deliver their AI projects in the most efficient and effective way possible.

Figure 1: AI Infrastructure Stack (Source: Intel Capital).

This technical infrastructure stack is focused on horizontal solutions that address fundamental needs in developing AI, regardless of the type of company or industry where it’s being deployed. We do not include vertical solutions that target specific industries.

The stack consists of seven layers—each divided into two parts, which comprise solutions built for very different workloads, amounts of data, compute and memory requirements, and SLAs:

  • Explore/training solutions, which crunch data and create models algorithmically.
  • Production/inference solutions, which respond using the trained models when recommendations are requested—e.g., to identify “you might also like” product suggestions on an e-commerce site or determine when to apply the brakes in a self-driving car.

Connecting everything is the enterprise’s distributed engine—the computation platforms that allocate workloads across compute resources.

The layers of the stack are:

  1. Hardware. The right hardware is the foundation of training solutions, which run in the data center, as well as of inference solutions, which run in data centers and edge devices. 
  1. Software Accelerator. These are compilers and low-level kernels used to optimize machine learning (ML) libraries. 
  1. Library. These are the libraries used to train ML models. 
  1. Data Science Framework. This layer comprises tools that integrate libraries with other tools.
  1. Orchestration. These tools package, deploy, and manage the execution of ML training and model inference. DevOps wouldn’t be possible without this layer. 
  1. Automation. These tools simplify and partially automate the preparation of data for model training, model training, and other ML tasks. 
  1. Autonomous. Tools in this layer automate aspects of building, deploying, or maintaining ML models. This is where AI trains AI.

The tools and services in each layer accelerate the development and deployment of AI; however, as with all emerging technologies, there are tradeoffs when deciding which to use. AutoML can fast-track the development of ML models, for example, but the training may not be as accurate as custom models.

Users must decide which tools and services to consume within each layer based on the requirements of their projects.

Figure 2: A detailed look at higher layers of our AI Infrastructure Stack (Source: Intel Capital). 

At the top of the AI value chain are the Orchestration, Automation, and Autonomous layers—with the Autonomous layer becoming more critical for democratizing AI by making it more accessible and easy to use by anyone, not just data scientists.

Although these are the newest layers of the stack, where AI tools and services are enabling continuous integration and continuous deployment (CI/CD) of AI, note that innovation is occurring across the entire stack— breaking new boundaries, increasing usability, and bringing AI to new communities.

Finally, we populated our model with examples of tools, services, and companies—many of them open source. They don’t include all marketplace options; they are a sample for those considering AI solutions, with a robust range of options for each layer.

Figure 3: Representative examples of tools, service, and companies in our AI infrastructure stack (Source: Intel Capital).

AI is no longer in its infancy. For companies seeking to use AI to improve their products and services, or to drive greater efficiency and improved decision-making, there’s now a rich ecosystem of tools and services for building, deploying, and monitoring ML and AI models.

Keeping track of all that’s going on in the field, and how it fits together, can be the difference-maker when it comes to the success of your AI project.

_________________________________________________

Assaf Araki is an investment manager focused on AI and data analytics platforms and products at Intel Capital. 

Ben Lorica, host of The Data Exchange podcast and program chair of the Spark+AI Summit and the Ray Summit, contributed to this post.

Graphics by Josiane Ishimwe, equity investor at Intel Capital.

Original post: https://www.datasciencecentral.com/profiles/blogs/demystifying-the-ai-infrastructure-stack

125 comentários em “Demystifying the AI Infrastructure Stack

  1. Hey there this is kind of of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML.
    I’m starting a blog soon but have no coding experience so I wanted to
    get advice from someone with experience. Any help would be
    greatly appreciated!

  2. I am really impressed along with your writing abilities and also with the format in your weblog.
    Is this a paid subject matter or did you customize it
    yourself? Either way keep up the nice high quality writing, it is rare to see
    a nice blog like this one nowadays..

  3. Remarkable things here. I’m very satisfied to peer your article.
    Thank you so much and I am taking a look ahead to contact you.
    Will you kindly drop me a e-mail?

  4. I’m the co-founder of JustCBD label (justcbdstore.com) and am seeking to broaden my wholesale side of company. It would be great if someone at targetdomain share some guidance . I thought that the most ideal way to accomplish this would be to connect to vape companies and cbd retailers. I was hoping if anyone could recommend a reliable website where I can get CBD Shops B2B Data I am already considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable option and would appreciate any assistance on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  5. What’s Going down i’m new to this, I stumbled upon this
    I have discovered It absolutely helpful and it has aided me
    out loads. I hope to contribute & help different customers like its
    aided me. Good job.

  6. I’m the business owner of JustCBD Store label (justcbdstore.com) and I’m presently aiming to expand my wholesale side of business. I am hoping someone at targetdomain is able to provide some guidance ! I thought that the most effective way to accomplish this would be to connect to vape shops and cbd retail stores. I was really hoping if anybody at all could recommend a reliable web site where I can purchase CBD Shops Business Data I am presently checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the most suitable solution and would appreciate any guidance on this. Or would it be easier for me to scrape my own leads? Ideas?

  7. I truly love your blog.. Very nice colors & theme. Did you create this amazing site yourself? Please reply back as I’m hoping to create my own site and would like to know where you got this from or just what the theme is called. Kudos!

  8. May I just say what a comfort to discover somebody that truly understands what they are discussing on the net. You actually realize how to bring a problem to light and make it important. A lot more people should read this and understand this side of your story. It’s surprising you’re not more popular given that you certainly have the gift.

  9. I’m pretty pleased to uncover this web site. I wanted to thank you for ones time for this fantastic read!! I definitely savored every little bit of it and i also have you book-marked to see new things on your web site.

  10. Have you ever thought about creating an e-book or guest authoring
    on other websites? I have a blog centered on the same topics you discuss and would love
    to have you share some stories/information. I know my viewers would appreciate your
    work. If you are even remotely interested, feel free to shoot me an e-mail.

  11. Your style is really unique compared to other people I’ve read stuff from. Many thanks for posting when you’ve got the opportunity, Guess I will just bookmark this page.

  12. Can I simply say what a comfort to uncover an individual who truly understands what they’re discussing on the web. You definitely know how to bring a problem to light and make it important. More people should check this out and understand this side of the story. I can’t believe you are not more popular because you surely possess the gift.

  13. I’m impressed, I have to admit. Rarely do I come across a blog
    that’s equally educative and engaging, and without
    a doubt, you have hit the nail on the head.
    The problem is something that too few people are speaking intelligently about.
    I’m very happy that I found this during my search for something concerning this.

  14. Wonderful beat ! I would like to apprentice while you amend your site, how can i subscribe for a blog web site?
    The account helped me a acceptable deal.
    I had been tiny bit acquainted of this your broadcast provided
    bright clear idea

  15. Howdy, I do think your website might be having browser compatibility issues. Whenever I look at your blog in Safari, it looks fine however, if opening in IE, it has some overlapping issues. I just wanted to provide you with a quick heads up! Besides that, excellent blog!

  16. I’m amazed, I must say. Seldom do I come across a blog that’s both educative and engaging, and without a doubt, you have hit the nail on the head. The problem is something too few men and women are speaking intelligently about. I’m very happy I found this in my search for something concerning this.

  17. Hi, Neat post. There is an issue together with your website in internet explorer, may
    test this? IE nonetheless is the marketplace leader
    and a huge component to folks will omit your magnificent writing due to this
    problem.

  18. Nice post. I learn something totally new and challenging on blogs I stumbleupon on a daily basis. It’s always useful to read content from other authors and use a little something from their sites.

  19. You are so cool! I do not believe I’ve truly read through something like that before. So nice to discover someone with a few unique thoughts on this subject. Really.. thanks for starting this up. This site is one thing that is needed on the internet, someone with some originality!

  20. I do accept as true with all the concepts you’ve introduced on your
    post. They’re really convincing and can definitely
    work. Still, the posts are very quick for beginners.
    May just you please lengthen them a bit from next time?
    Thanks for the post. adreamoftrains website hosting

  21. My spouse and I absolutely love your blog and find nearly all
    of your post’s to be exactly what I’m looking for. can you offer guest writers to write content
    for you? I wouldn’t mind producing a post or elaborating on a
    number of the subjects you write about here. Again, awesome site!

  22. Your style is so unique in comparison to other people I’ve read stuff from. Thank you for posting when you’ve got the opportunity, Guess I’ll just bookmark this page.

  23. When I originally commented I appear to have clicked the -Notify me when new comments are added- checkbox and now every time a comment is added I get 4 emails with the exact same comment. Is there a way you can remove me from that service? Appreciate it!

  24. Hi there! This post couldn’t be written much better! Looking at this article reminds me of my previous roommate! He always kept preaching about this. I’ll send this article to him. Fairly certain he’s going to have a great read. Thanks for sharing!

  25. Hi there! I could have sworn I’ve visited this site before but after looking at some of the articles I realized it’s new to me. Anyhow, I’m definitely happy I stumbled upon it and I’ll be book-marking it and checking back often!

  26. This is the perfect site for anybody who hopes to find out about this topic. You realize a whole lot its almost tough to argue with you (not that I personally will need to…HaHa). You definitely put a brand new spin on a topic that has been written about for a long time. Wonderful stuff, just excellent!

  27. I blog frequently and I genuinely thank you for your information. This article has truly peaked my interest. I am going to take a note of your website and keep checking for new information about once per week. I opted in for your RSS feed as well.

  28. Admiring the dedication you put into your blog and detailed information you present.
    It’s great to come across a blog every once in a while that
    isn’t the same unwanted rehashed material. Excellent read!
    I’ve saved your site and I’m adding your RSS feeds to my Google account.

  29. After checking out a handful of the blog posts on your web page, I really appreciate your way of writing a blog. I added it to my bookmark webpage list and will be checking back soon. Take a look at my web site too and let me know how you feel.

  30. An outstanding share! I have just forwarded this onto a colleague who was doing a little homework on this. And he actually bought me dinner because I stumbled upon it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending time to talk about this subject here on your web page.

  31. Howdy! I know this is kind of off topic but I was wondering if you knew where I could locate a captcha plugin for my comment form?
    I’m using the same blog platform as yours and I’m having problems finding one?
    Thanks a lot!

  32. I blog often and I genuinely appreciate your content. This article has truly peaked my interest. I am going to book mark your site and keep checking for new information about once per week. I subscribed to your RSS feed too.

  33. Wonderful goods from you, man. I’ve understand
    your stuff previous to and you are just too magnificent. I really like
    what you have acquired here, certainly like what you are stating and the way in which
    you say it. You make it entertaining and you still take care of to keep it
    sensible. I can not wait to read much more from you.
    This is actually a wonderful site.

  34. Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point.

    You clearly know what youre talking about, why waste your intelligence on just posting videos to your site when you could be giving us something enlightening to read?

  35. Hi there excellent blog! Does running a blog similar to this take a massive amount work?
    I have very little understanding of computer programming but I was hoping to start my own blog soon.
    Anyway, if you have any recommendations or techniques for new blog
    owners please share. I understand this is off subject but
    I simply had to ask. Many thanks! adreamoftrains best web hosting sites

  36. Having read this I believed it was rather enlightening. I appreciate you spending some time and effort to put this content together. I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!

  37. Nice post. I learn something totally new and challenging on blogs I stumbleupon on a daily basis. It’s always helpful to read articles from other writers and practice something from other sites.

  38. May I simply say what a relief to uncover an individual who actually knows what they are talking about on the internet. You actually realize how to bring an issue to light and make it important. A lot more people really need to read this and understand this side of the story. I can’t believe you’re not more popular given that you most certainly have the gift.

  39. I truly love your site.. Pleasant colors & theme. Did you build this amazing site yourself? Please reply back as I’m attempting to create my own personal site and would love to learn where you got this from or what the theme is named. Many thanks!

  40. Attractive portion of content. I simply stumbled upon your website
    and in accession capital to assert that I acquire in fact enjoyed account your blog posts.

    Any way I will be subscribing for your feeds and even I achievement you get entry to consistently rapidly.

  41. Aw, this was a really good post. Taking a few minutes and actual effort to create a good article…
    but what can I say… I procrastinate a whole lot and never manage to get nearly anything done.

  42. I’m very pleased to find this great site. I need to to thank you for ones time just for this wonderful read!! I definitely loved every little bit of it and i also have you saved to fav to check out new information in your site.

  43. I’m extremely inspired with your writing skills as neatly as with the layout on your weblog.

    Is this a paid subject or did you customize it your
    self? Either way keep up the nice quality writing, it is rare to peer a nice weblog like
    this one these days..

  44. Nice post. I learn something totally new and challenging on websites I stumbleupon everyday. It’s always interesting to read articles from other authors and practice a little something from their sites.

  45. I seriously love your site.. Pleasant colors & theme. Did you develop this web site yourself? Please reply back as I’m attempting to create my very own blog and would love to know where you got this from or exactly what the theme is named. Thanks!

  46. Hi, I do think this is an excellent web site. I stumbledupon it 😉 I am going to come back once again since i have bookmarked it. Money and freedom is the best way to change, may you be rich and continue to help other people.

  47. I seriously love your site.. Very nice colors & theme. Did you make this website yourself? Please reply back as I’m planning to create my very own site and would like to learn where you got this from or what the theme is called. Thanks!

  48. Your style is so unique compared to other people I’ve read stuff from. Thanks for posting when you’ve got the opportunity, Guess I will just bookmark this site.

  49. You’re so interesting! I do not believe I’ve truly read through anything like that before. So nice to discover another person with genuine thoughts on this issue. Really.. thanks for starting this up. This web site is one thing that is required on the internet, someone with a bit of originality!

  50. Howdy! This article could not be written any better! Going through this post reminds me of my previous roommate! He always kept preaching about this. I’ll send this information to him. Pretty sure he’s going to have a great read. Thank you for sharing!|

  51. I blog quite often and I truly appreciate your content. Your article has truly peaked my interest. I’m going to book mark your site and keep checking for new information about once per week. I opted in for your Feed as well.

  52. You’re so interesting! I don’t believe I’ve truly read a single thing like that before. So good to discover someone with a few genuine thoughts on this topic. Really.. thank you for starting this up. This website is something that’s needed on the internet, someone with a little originality!

  53. I blog frequently and I genuinely thank you for your information. The article has really peaked my interest. I am going to book mark your blog and keep checking for new details about once a week. I opted in for your RSS feed as well.

  54. Having read this I thought it was really enlightening.

    I appreciate you taking the time and energy to put this short article
    together. I once again find myself spending way too much
    time both reading and posting comments. But so what,
    it was still worthwhile!

  55. Everything is very open with a clear description of the challenges. It was truly informative. Your website is very helpful. Many thanks for sharing!

  56. An interesting discussion is definitely worth comment. I think that you should write more about this issue, it may not be a taboo subject but typically folks don’t speak about these issues. To the next! Cheers!!

  57. I was very happy to find this website. I want to to thank you for your time for this fantastic read!! I definitely liked every part of it and i also have you bookmarked to see new things in your blog.

  58. Hi, I do think this is an excellent blog. I stumbledupon it 😉 I’m going to revisit once again since i have bookmarked it. Money and freedom is the greatest way to change, may you be rich and continue to guide others.

  59. I would like to thank you for the efforts you’ve put in penning this site. I’m hoping to check out the same high-grade content from you in the future as well. In truth, your creative writing abilities has encouraged me to get my very own site now 😉

  60. A person essentially assist to make seriously articles I’d state. This is the first time I frequented your website page and up to now? I surprised with the analysis you made to make this actual submit extraordinary. Fantastic activity!|

  61. I’m impressed, I have to admit. Rarely do I encounter a blog that’s both educative and interesting, and without a doubt, you’ve hit the nail on the head. The problem is something which too few folks are speaking intelligently about. I’m very happy that I found this during my hunt for something concerning this.

  62. May I just say what a comfort to find someone who really knows what they’re talking about on the net. You definitely realize how to bring an issue to light and make it important. More and more people should look at this and understand this side of the story. It’s surprising you are not more popular given that you definitely possess the gift.

  63. Oh my goodness! Amazing article dude! Many thanks, However I am going through issues with your RSS. I don’t know the reason why I can’t join it. Is there anybody else getting similar RSS issues? Anyone that knows the solution will you kindly respond? Thanks!!

  64. Greetings, There’s no doubt that your site could possibly be having web browser compatibility problems. When I look at your web site in Safari, it looks fine however, if opening in Internet Explorer, it’s got some overlapping issues. I just wanted to provide you with a quick heads up! Besides that, fantastic website!

  65. Good post. I learn something totally new and challenging on websites I stumbleupon everyday. It’s always useful to read through content from other writers and practice a little something from other web sites.

Leave a Reply

Your email address will not be published. Required fields are marked *