As companies increase their investments in artificial intelligence (AI), there is growing pressure on developers and engineers to deploy AI projects more quickly and at greater scale across the enterprise.
Simply evaluating the ever-expanding universe of AI tools and services— often designed for different users and purposes—is a significant challenge in this growing and fast-moving environment.
To address this challenge, we have created the AI Infrastructure Stack, a landscape map that brings greater clarity to the AI ecosystem by charting the layers of the AI technical stack and the vendors within each layer.
At Intel Capital this helps us identify the investments we believe will have the greatest positive impact on the future of AI, but it also helps developers and engineers identify the resources they need to deliver their AI projects in the most efficient and effective way possible.
Figure 1: AI Infrastructure Stack (Source: Intel Capital).
This technical infrastructure stack is focused on horizontal solutions that address fundamental needs in developing AI, regardless of the type of company or industry where it’s being deployed. We do not include vertical solutions that target specific industries.
The stack consists of seven layers—each divided into two parts, which comprise solutions built for very different workloads, amounts of data, compute and memory requirements, and SLAs:
- Explore/training solutions, which crunch data and create models algorithmically.
- Production/inference solutions, which respond using the trained models when recommendations are requested—e.g., to identify “you might also like” product suggestions on an e-commerce site or determine when to apply the brakes in a self-driving car.
Connecting everything is the enterprise’s distributed engine—the computation platforms that allocate workloads across compute resources.
The layers of the stack are:
- Hardware. The right hardware is the foundation of training solutions, which run in the data center, as well as of inference solutions, which run in data centers and edge devices.
- Software Accelerator. These are compilers and low-level kernels used to optimize machine learning (ML) libraries.
- Library. These are the libraries used to train ML models.
- Data Science Framework. This layer comprises tools that integrate libraries with other tools.
- Orchestration. These tools package, deploy, and manage the execution of ML training and model inference. DevOps wouldn’t be possible without this layer.
- Automation. These tools simplify and partially automate the preparation of data for model training, model training, and other ML tasks.
- Autonomous. Tools in this layer automate aspects of building, deploying, or maintaining ML models. This is where AI trains AI.
The tools and services in each layer accelerate the development and deployment of AI; however, as with all emerging technologies, there are tradeoffs when deciding which to use. AutoML can fast-track the development of ML models, for example, but the training may not be as accurate as custom models.
Users must decide which tools and services to consume within each layer based on the requirements of their projects.
Figure 2: A detailed look at higher layers of our AI Infrastructure Stack (Source: Intel Capital).
At the top of the AI value chain are the Orchestration, Automation, and Autonomous layers—with the Autonomous layer becoming more critical for democratizing AI by making it more accessible and easy to use by anyone, not just data scientists.
Although these are the newest layers of the stack, where AI tools and services are enabling continuous integration and continuous deployment (CI/CD) of AI, note that innovation is occurring across the entire stack— breaking new boundaries, increasing usability, and bringing AI to new communities.
Finally, we populated our model with examples of tools, services, and companies—many of them open source. They don’t include all marketplace options; they are a sample for those considering AI solutions, with a robust range of options for each layer.
Figure 3: Representative examples of tools, service, and companies in our AI infrastructure stack (Source: Intel Capital).
AI is no longer in its infancy. For companies seeking to use AI to improve their products and services, or to drive greater efficiency and improved decision-making, there’s now a rich ecosystem of tools and services for building, deploying, and monitoring ML and AI models.
Keeping track of all that’s going on in the field, and how it fits together, can be the difference-maker when it comes to the success of your AI project.
_________________________________________________
Assaf Araki is an investment manager focused on AI and data analytics platforms and products at Intel Capital.
Ben Lorica, host of The Data Exchange podcast and program chair of the Spark+AI Summit and the Ray Summit, contributed to this post.
Graphics by Josiane Ishimwe, equity investor at Intel Capital.
Original post: https://www.datasciencecentral.com/profiles/blogs/demystifying-the-ai-infrastructure-stack
Hello, I read your new stuff on a regular basis.
Your humoristic style is witty, keep doing what you’re doing!
Your way of describing the whole thing in this piece of writing is truly fastidious, all be able to without
difficulty know it, Thanks a lot.
Hey there this is kind of of off topic but I was wondering if blogs use WYSIWYG editors or if you have to manually code with HTML.
I’m starting a blog soon but have no coding experience so I wanted to
get advice from someone with experience. Any help would be
greatly appreciated!
I am really impressed along with your writing abilities and also with the format in your weblog.
Is this a paid subject matter or did you customize it
yourself? Either way keep up the nice high quality writing, it is rare to see
a nice blog like this one nowadays..
Good blog you’ve got here.. It’s hard to find high quality writing
like yours these days. I truly appreciate people like you!
Take care!!
Remarkable things here. I’m very satisfied to peer your article.
Thank you so much and I am taking a look ahead to contact you.
Will you kindly drop me a e-mail?
My family all the time say that I am killing my time here
at net, except I know I am getting knowledge every day by reading
thes good posts.
My relatives always say that I am killing my time here at web,
but I know I am getting knowledge all the time by reading such pleasant posts.
I’m the co-founder of JustCBD label (justcbdstore.com) and am seeking to broaden my wholesale side of company. It would be great if someone at targetdomain share some guidance . I thought that the most ideal way to accomplish this would be to connect to vape companies and cbd retailers. I was hoping if anyone could recommend a reliable website where I can get CBD Shops B2B Data I am already considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the most suitable option and would appreciate any assistance on this. Or would it be simpler for me to scrape my own leads? Suggestions?
What’s Going down i’m new to this, I stumbled upon this
I have discovered It absolutely helpful and it has aided me
out loads. I hope to contribute & help different customers like its
aided me. Good job.
Hi my family member! I want to say that this post
is amazing, great written and come with approximately all vital infos.
I would like to look more posts like this .
I’m the business owner of JustCBD Store label (justcbdstore.com) and I’m presently aiming to expand my wholesale side of business. I am hoping someone at targetdomain is able to provide some guidance ! I thought that the most effective way to accomplish this would be to connect to vape shops and cbd retail stores. I was really hoping if anybody at all could recommend a reliable web site where I can purchase CBD Shops Business Data I am presently checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the most suitable solution and would appreciate any guidance on this. Or would it be easier for me to scrape my own leads? Ideas?
I truly love your blog.. Very nice colors & theme. Did you create this amazing site yourself? Please reply back as I’m hoping to create my own site and would like to know where you got this from or just what the theme is called. Kudos!
May I just say what a comfort to discover somebody that truly understands what they are discussing on the net. You actually realize how to bring a problem to light and make it important. A lot more people should read this and understand this side of your story. It’s surprising you’re not more popular given that you certainly have the gift.
I’m pretty pleased to uncover this web site. I wanted to thank you for ones time for this fantastic read!! I definitely savored every little bit of it and i also have you book-marked to see new things on your web site.
Wonderful post! We are linking to this particularly great article on our site. Keep up the great writing.
You made some good points there. I looked on the web to learn more about the issue and found most individuals will go along with your views on this site.
You’ve made some decent points there. I checked on the internet to learn more about the issue and found most individuals will go along with your views on this website.
Have you ever thought about creating an e-book or guest authoring
on other websites? I have a blog centered on the same topics you discuss and would love
to have you share some stories/information. I know my viewers would appreciate your
work. If you are even remotely interested, feel free to shoot me an e-mail.
Your style is really unique compared to other people I’ve read stuff from. Many thanks for posting when you’ve got the opportunity, Guess I will just bookmark this page.
This post will assist the internet viewers for creating new weblog or even a blog from start to end.
Can I simply say what a comfort to uncover an individual who truly understands what they’re discussing on the web. You definitely know how to bring a problem to light and make it important. More people should check this out and understand this side of the story. I can’t believe you are not more popular because you surely possess the gift.
Way cool! Some extremely valid points! I appreciate you writing this post and the rest of the site is extremely good.
I’m impressed, I have to admit. Rarely do I come across a blog
that’s equally educative and engaging, and without
a doubt, you have hit the nail on the head.
The problem is something that too few people are speaking intelligently about.
I’m very happy that I found this during my search for something concerning this.
bookmarked!!, I like your site!
Wonderful beat ! I would like to apprentice while you amend your site, how can i subscribe for a blog web site?
The account helped me a acceptable deal.
I had been tiny bit acquainted of this your broadcast provided
bright clear idea
Very good article! We will be linking to this great article on our website. Keep up the great writing.
Howdy, I do think your website might be having browser compatibility issues. Whenever I look at your blog in Safari, it looks fine however, if opening in IE, it has some overlapping issues. I just wanted to provide you with a quick heads up! Besides that, excellent blog!
I’m amazed, I must say. Seldom do I come across a blog that’s both educative and engaging, and without a doubt, you have hit the nail on the head. The problem is something too few men and women are speaking intelligently about. I’m very happy I found this in my search for something concerning this.
Hi, Neat post. There is an issue together with your website in internet explorer, may
test this? IE nonetheless is the marketplace leader
and a huge component to folks will omit your magnificent writing due to this
problem.
Nice post. I learn something totally new and challenging on blogs I stumbleupon on a daily basis. It’s always useful to read content from other authors and use a little something from their sites.
You are so cool! I do not believe I’ve truly read through something like that before. So nice to discover someone with a few unique thoughts on this subject. Really.. thanks for starting this up. This site is one thing that is needed on the internet, someone with some originality!
I do accept as true with all the concepts you’ve introduced on your
post. They’re really convincing and can definitely
work. Still, the posts are very quick for beginners.
May just you please lengthen them a bit from next time?
Thanks for the post. adreamoftrains website hosting
I couldn’t resist commenting. Well written!
My spouse and I absolutely love your blog and find nearly all
of your post’s to be exactly what I’m looking for. can you offer guest writers to write content
for you? I wouldn’t mind producing a post or elaborating on a
number of the subjects you write about here. Again, awesome site!
Your style is so unique in comparison to other people I’ve read stuff from. Thank you for posting when you’ve got the opportunity, Guess I’ll just bookmark this page.
It’s difficult to find educated people about this subject, but you seem like you know what you’re talking about! Thanks
When I originally commented I appear to have clicked the -Notify me when new comments are added- checkbox and now every time a comment is added I get 4 emails with the exact same comment. Is there a way you can remove me from that service? Appreciate it!
Hi there! This post couldn’t be written much better! Looking at this article reminds me of my previous roommate! He always kept preaching about this. I’ll send this article to him. Fairly certain he’s going to have a great read. Thanks for sharing!
Hi there! I could have sworn I’ve visited this site before but after looking at some of the articles I realized it’s new to me. Anyhow, I’m definitely happy I stumbled upon it and I’ll be book-marking it and checking back often!
Greetings! Very useful advice in this particular post! It is the little changes that make the most significant changes. Many thanks for sharing!
It’s hard to come by well-informed people about this subject, but you sound like you know what you’re talking about! Thanks
This is the perfect site for anybody who hopes to find out about this topic. You realize a whole lot its almost tough to argue with you (not that I personally will need to…HaHa). You definitely put a brand new spin on a topic that has been written about for a long time. Wonderful stuff, just excellent!
I could not resist commenting. Very well written!
I blog frequently and I genuinely thank you for your information. This article has truly peaked my interest. I am going to take a note of your website and keep checking for new information about once per week. I opted in for your RSS feed as well.
Hey there! I’ve been reading your site for a long time now and finally got the courage to go ahead and give you a
shout out from Huffman Tx! Just wanted to mention keep
up the great job!
Admiring the dedication you put into your blog and detailed information you present.
It’s great to come across a blog every once in a while that
isn’t the same unwanted rehashed material. Excellent read!
I’ve saved your site and I’m adding your RSS feeds to my Google account.
After checking out a handful of the blog posts on your web page, I really appreciate your way of writing a blog. I added it to my bookmark webpage list and will be checking back soon. Take a look at my web site too and let me know how you feel.
An outstanding share! I have just forwarded this onto a colleague who was doing a little homework on this. And he actually bought me dinner because I stumbled upon it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending time to talk about this subject here on your web page.
Howdy! I know this is kind of off topic but I was wondering if you knew where I could locate a captcha plugin for my comment form?
I’m using the same blog platform as yours and I’m having problems finding one?
Thanks a lot!
It’s hard to come by knowledgeable people on this subject, however, you sound like you know what you’re talking about! Thanks
I blog often and I genuinely appreciate your content. This article has truly peaked my interest. I am going to book mark your site and keep checking for new information about once per week. I subscribed to your RSS feed too.
Wonderful goods from you, man. I’ve understand
your stuff previous to and you are just too magnificent. I really like
what you have acquired here, certainly like what you are stating and the way in which
you say it. You make it entertaining and you still take care of to keep it
sensible. I can not wait to read much more from you.
This is actually a wonderful site.
Write more, thats all I have to say. Literally, it seems as though you relied on the video to make your point.
You clearly know what youre talking about, why waste your intelligence on just posting videos to your site when you could be giving us something enlightening to read?
Excellent blog you have got here.. It’s hard to find excellent writing like yours nowadays. I truly appreciate individuals like you! Take care!!
Hi there excellent blog! Does running a blog similar to this take a massive amount work?
I have very little understanding of computer programming but I was hoping to start my own blog soon.
Anyway, if you have any recommendations or techniques for new blog
owners please share. I understand this is off subject but
I simply had to ask. Many thanks! adreamoftrains best web hosting sites
Thank you for sharing your info. I truly appreciate your efforts and I will be waiting for your next
post thank you once again.
I really like looking through an article that will make men and women think.
Also, thank you for permitting me to comment!
It’s difficult to find knowledgeable people for this topic, however, you sound like you know what you’re talking about! Thanks
Having read this I believed it was rather enlightening. I appreciate you spending some time and effort to put this content together. I once again find myself spending a lot of time both reading and commenting. But so what, it was still worthwhile!
Way cool! Some extremely valid points! I appreciate you penning this article plus the rest of the site is extremely good.
Nice post. I learn something totally new and challenging on blogs I stumbleupon on a daily basis. It’s always helpful to read articles from other writers and practice something from other sites.
May I simply say what a relief to uncover an individual who actually knows what they are talking about on the internet. You actually realize how to bring an issue to light and make it important. A lot more people really need to read this and understand this side of the story. I can’t believe you’re not more popular given that you most certainly have the gift.
I truly love your site.. Pleasant colors & theme. Did you build this amazing site yourself? Please reply back as I’m attempting to create my own personal site and would love to learn where you got this from or what the theme is named. Many thanks!
Attractive portion of content. I simply stumbled upon your website
and in accession capital to assert that I acquire in fact enjoyed account your blog posts.
Any way I will be subscribing for your feeds and even I achievement you get entry to consistently rapidly.
Aw, this was a really good post. Taking a few minutes and actual effort to create a good article…
but what can I say… I procrastinate a whole lot and never manage to get nearly anything done.
I’m very pleased to find this great site. I need to to thank you for ones time just for this wonderful read!! I definitely loved every little bit of it and i also have you saved to fav to check out new information in your site.
Greetings! Very helpful advice in this particular post! It is the little changes that will make the biggest changes. Many thanks for sharing!
I’m extremely inspired with your writing skills as neatly as with the layout on your weblog.
Is this a paid subject or did you customize it your
self? Either way keep up the nice quality writing, it is rare to peer a nice weblog like
this one these days..
Nice post. I learn something totally new and challenging on websites I stumbleupon everyday. It’s always interesting to read articles from other authors and practice a little something from their sites.
Very good post! We will be linking to this great post on our website. Keep up the good writing.
I seriously love your site.. Pleasant colors & theme. Did you develop this web site yourself? Please reply back as I’m attempting to create my very own blog and would love to know where you got this from or exactly what the theme is named. Thanks!
This blog was… how do I say it? Relevant!! Finally I have found something that helped me. Many thanks!
This excellent website really has all the information and facts I needed concerning this subject and didn’t know who to ask.
Hi, I do think this is an excellent web site. I stumbledupon it 😉 I am going to come back once again since i have bookmarked it. Money and freedom is the best way to change, may you be rich and continue to help other people.
I love looking through a post that will make people think. Also, thanks for allowing for me to comment!
I seriously love your site.. Very nice colors & theme. Did you make this website yourself? Please reply back as I’m planning to create my very own site and would like to learn where you got this from or what the theme is called. Thanks!
Pretty! This has been a really wonderful article. Thank you for supplying this information.
I needed to thank you for this good read!! I absolutely loved every bit of it. I’ve got you saved as a favorite to look at new stuff you post…
I enjoy reading an article that can make people think. Also, thanks for allowing for me to comment!
Excellent web site you have got here.. It’s difficult to find high-quality writing like yours these days. I seriously appreciate people like you! Take care!!
Your style is so unique in comparison to other folks I’ve read stuff from. Thanks for posting when you’ve got the opportunity, Guess I will just book mark this site.
I enjoy looking through a post that will make men and women think. Also, many thanks for allowing me to comment!
Greetings! Very useful advice within this post! It’s the little changes that produce the biggest changes. Thanks a lot for sharing!
This page really has all of the info I needed concerning this subject and didn’t know who to ask.
Your style is so unique compared to other people I’ve read stuff from. Thanks for posting when you’ve got the opportunity, Guess I will just bookmark this site.
Saved as a favorite, I love your site!
You’re so interesting! I do not believe I’ve truly read through anything like that before. So nice to discover another person with genuine thoughts on this issue. Really.. thanks for starting this up. This web site is one thing that is required on the internet, someone with a bit of originality!
It’s nearly impossible to find well-informed people on this topic, however, you sound like you know what you’re talking about! Thanks
That is a great tip especially to those new to the blogosphere. Simple but very precise information… Appreciate your sharing this one. A must read article!
Howdy! This article could not be written any better! Going through this post reminds me of my previous roommate! He always kept preaching about this. I’ll send this information to him. Pretty sure he’s going to have a great read. Thank you for sharing!|
I blog quite often and I truly appreciate your content. Your article has truly peaked my interest. I’m going to book mark your site and keep checking for new information about once per week. I opted in for your Feed as well.
You’re so interesting! I don’t believe I’ve truly read a single thing like that before. So good to discover someone with a few genuine thoughts on this topic. Really.. thank you for starting this up. This website is something that’s needed on the internet, someone with a little originality!
I blog frequently and I genuinely thank you for your information. The article has really peaked my interest. I am going to book mark your blog and keep checking for new details about once a week. I opted in for your RSS feed as well.
Achieving your fitness goal does not need a certified personal trainer or an expensive gym memberships, especially if you have the budget and the space to consider practically every workout machine in the market.
Having read this I thought it was really enlightening.
I appreciate you taking the time and energy to put this short article
together. I once again find myself spending way too much
time both reading and posting comments. But so what,
it was still worthwhile!
This post will assist the internet visitors for creating new webpage or even a
blog from start to end. 3aN8IMa cheap flights
This is a topic that is near to my heart… Thank you! Exactly where are your contact details though?
Everything is very open with a clear description of the challenges. It was truly informative. Your website is very helpful. Many thanks for sharing!
Greetings! Very helpful advice within this post! It is the little changes which will make the biggest changes. Thanks a lot for sharing!
Very shortly this web site will be famous among all
blogging and site-building visitors, due to it’s good posts y2yxvvfw cheap flights
Saved as a favorite, I like your blog!
Good blog post. I absolutely appreciate this website. Stick with it!
Way cool! Some very valid points! I appreciate you writing this write-up and also the rest of the site is really good.
Great article. I will be facing some of these issues as well..
bookmarked!!, I love your blog!
An interesting discussion is definitely worth comment. I think that you should write more about this issue, it may not be a taboo subject but typically folks don’t speak about these issues. To the next! Cheers!!
I was very happy to find this website. I want to to thank you for your time for this fantastic read!! I definitely liked every part of it and i also have you bookmarked to see new things in your blog.
I really like looking through a post that will make people think. Also, thanks for permitting me to comment!
Your style is very unique in comparison to other people I have read stuff from. Many thanks for posting when you have the opportunity, Guess I’ll just book mark this blog.
Hi, I do think this is an excellent blog. I stumbledupon it 😉 I’m going to revisit once again since i have bookmarked it. Money and freedom is the greatest way to change, may you be rich and continue to guide others.
I would like to thank you for the efforts you’ve put in penning this site. I’m hoping to check out the same high-grade content from you in the future as well. In truth, your creative writing abilities has encouraged me to get my very own site now 😉
I was able to find good info from your blog articles.
Very nice article. I certainly love this website. Keep it up!
Hi! I just want to give you a huge thumbs up for the excellent information you’ve got here on this post. I’ll be returning to your website for more soon.
A person essentially assist to make seriously articles I’d state. This is the first time I frequented your website page and up to now? I surprised with the analysis you made to make this actual submit extraordinary. Fantastic activity!|
I’m impressed, I have to admit. Rarely do I encounter a blog that’s both educative and interesting, and without a doubt, you’ve hit the nail on the head. The problem is something which too few folks are speaking intelligently about. I’m very happy that I found this during my hunt for something concerning this.
I used to be able to find good information from your blog posts.
This blog was… how do I say it? Relevant!! Finally I have found something which helped me. Cheers!
May I just say what a comfort to find someone who really knows what they’re talking about on the net. You definitely realize how to bring an issue to light and make it important. More and more people should look at this and understand this side of the story. It’s surprising you are not more popular given that you definitely possess the gift.
Wow, that’s what I was searching for, what a information! existing here at this blog, thanks admin of this site.|
Oh my goodness! Amazing article dude! Many thanks, However I am going through issues with your RSS. I don’t know the reason why I can’t join it. Is there anybody else getting similar RSS issues? Anyone that knows the solution will you kindly respond? Thanks!!
Everything is very open with a precise clarification of the issues. It was really informative. Your website is useful. Thanks for sharing!
Greetings, There’s no doubt that your site could possibly be having web browser compatibility problems. When I look at your web site in Safari, it looks fine however, if opening in Internet Explorer, it’s got some overlapping issues. I just wanted to provide you with a quick heads up! Besides that, fantastic website!
Good post. I learn something totally new and challenging on websites I stumbleupon everyday. It’s always useful to read through content from other writers and practice a little something from other web sites.
bookmarked!!, I like your web site!
Greetings! Very useful advice within this post! It is the little changes that make the most important changes. Thanks for sharing!
I wanted to thank you for this wonderful read!! I absolutely loved every bit of it. I’ve got you saved as a favorite to check out new stuff you post…
https://myanimelist.net/profile/alpineskipper
I wanted to thank you for this great read!! I definitely enjoyed every bit of it. I have you saved as a favorite to look at new stuff you post…
You should take part in a contest for one of the finest websites on the web. I most certainly will recommend this blog!
I’m excited to discover this web site. I need to to thank you for ones time just for this fantastic read!! I definitely appreciated every part of it and I have you book marked to look at new things in your website.
Great article. I will be going through many of these issues as well..
I loved your blog article.Really looking forward to read more. Keep writing.
Best view i have ever seen !
Best view i have ever seen !