Leverage AI to Create Autonomous Policies that Adapts without Human Intervention

Leverage AI to Create Autonomous Policies that Learn and Adapt without Human Intervention

Policies are the foundation for any successful organization.  Policies are the rules, or laws, of an organization.  Policies document the principles, best practices and compliance guidelines that aid decision-making in supporting the consistent and repeatable operations of the business. Heck, one could argue that an organization’s culture is better defined by its policies than it is by the character of its leadership team.

Unfortunately, the management, creation and execution of policies haven’t changed much since the days of “time-and-motion studies”.  In many cases, policies are nothing more than a static list of what-if rules that govern what workers are to do in well-defined situations.  For example, [If your car has been driven over 3,000 miles since the last oil change, thenchange the oil] or [If you haven’t visited the dentist in greater than 6 months, then visit the dentist].

But what if…what if these policies weren’t just static if-then rules but were instead AI-based models that changed to optimize the actions based upon the constantly evolving state of the environment in which the business operates…without human intervention?

In much the same way that we are seeing AI being used to create autonomous vehicles, robots and devices that learn and adapt without human intervention, can we leverage AI to create autonomous policies that learn and adapt without human intervention?

Creating Autonomous Policies

First, let’s modernize our definition of “policy”:

A “Policy” is a codified set of agent-based (human or machine) analytics that guide actions (or decisions) based upon current state (or environment) that optimize, automate and operationalize (scale) an organization’s business and operational models. 

And my hypothesis is this: if a policy can be documented and automated, then it can be integrated with AI / ML to become autonomous so that the policies and procedures learn and adapt without human intervention. Policies that self-monitor, self-diagnose, self-learn and self-change/evolve?

Identify à Document à Codify à Automate + AI/MLDL yields Autonomous policies that learn and continuously evolve without human intervention

If an autonomous device can gain information about the environment through interaction, learn through those interactions and update its operating model without human intervention, then why can’t the policies that support the operations of the business do the same thing?

Achieving Autonomous 

Achieving Autonomous hinges on the ability to apply AI, or Deep Reinforcement Learning, to the governance and evolution of these policies. Deep Reinforcement Learning is the combination of a deep Neural Network (Convolutional Neural Network) for image recognition and classification, with Reinforcement Learning for autonomous agents to learn and improve operational effectiveness to yield.  Combining convolutional neural networks (CNN) with Reinforcement Learning allows the agent to recognize its current state and rank the best actions to perform given that current state.

The goal of Deep Reinforcement Learning is for an autonomous “agent” to learn a successful strategy from continuous engagement with the environment.  With the optimal strategy, the agent can actively adapt to the changing environment to maximize rewards (current and future) while minimizing costs (see Figure 1).

No alt text provided for this image

Figure 1: An agent interacts with its environment, trying to take actions to maximize cumulative rewards

Deep Reinforcement Learning factors in Figure 1 include:

  • State:  Current position of all entities with the surrounding environment. For an autonomous vehicle, it would be the location, direction and speed of all the surrounding entities including other cars, cyclists and pedestrians).
  • Action: Inventory of potential actions.  For our autonomous vehicle, that inventory of potential actions could include turn, stop, slow down, accelerate, and reverse.
  • Rewards: Maximizing Positive Rewards (safely navigate to next location, safely getting to final destination) while minimizing Negative Rewards (crash, wasting fuel, increasing carbon emissions, injuring others, traffic tickets)
  • Policy:  State-to-action mapping that defines what actions the agent should take in a given situation in order to maximize its positive rewards while minimizing its negative rewards

For example, today we have a society policy or rule dictating what drivers are supposed to do when they arrive at an intersection at the same time. When two vehicles arrive at a 4-way stop at the same time, and they are located head-to-head and one of the vehicles intends to turn right and the other intends to turn left, the vehicle turning right has right of way. Move forward slowly before entering the intersection to indicate to other drivers you are making the turn. The driver turning left should wait until the other car has fully passed (see Figure 2).

No alt text provided for this image

Figure 2: “The 4 Rules of 4-Way Stops

However, in a word of autonomous vehicles, those if-then rules to guide safe decisions navigating an intersection just won’t work. The promise of flawless traffic and reduced traffic congestion would give way to a series of frustrated autonomous vehicles starting and stopping at the intersection.

So instead of the old policy for determining to whom to defer when multiple cars arrive at the intersection at the same time, we’d have to develop a new policy that can continuously learn and evolve as the flow and density of traffic patterns changes throughout the day and in response to special events and situations (see Figure 3).

Figure 3: Enterprise TV Commercial, ‘The Future of Transportation

The autonomous vehicle (agent) must constantly monitor, diagnose and learn in order to actively adapt to the changing environment to maximize future rewards while minimizing costs without human intervention.

Creating Autonomous Policies

If an autonomous device or vehicle can gain information about the environment through interaction, learn through those interactions and update its operating model without human intervention, then why can’t the policies that support the operations of the business do the same thing?  For example:

·       A Predictive Maintenance Policy that took into consideration for each part such factors as remaining useful life, demand forecasts, product performance anomaly detection, costs of that inventory, amount of that inventory, location of that inventory and the relative importance of that part to overall operations (for example in operating a hotel, one might accept a less accurate Predictive Maintenance policy for light bulbs which have minimal importance versus an air conditioning unit or an elevator for which downtime could have a substantial impact on profits and guest satisfaction) to make its prescriptive recommended actions.

·       An Inventory Optimization Policy that took into consideration for each inventory item such factors as demand forecast, remaining useful life, supplier reliability anomaly detection, current inventory levels and inventory locations, projected obsolete inventory, etc. to make its prescriptive recommended actions.

·       A Customer Retention Policy that took into consideration for each customer such factors as purchase or engagement history, purchase or engagement anomaly detection, current lifetime value for that customer, [Predicted Customer Lifetime Value] (that took into consideration such factors as current life stage because if you are now an empty-nester, you are probably suddenly less valuable to a Theme Park operator) to make its prescriptive recommended actions.

Summary: Creating an Autonomous Business

Using Deep Reinforcement Learning, we can transition from static policies to autonomous policies that learn how to map any given situation (or state) to an action to reach a desired goal or objective without human intervention. These autonomous policies would dynamically learn and update in response to constantly changing environmental factors (such as changes in weather patterns, economic conditions, price of commodities, trade and deficit balances, global GDP growth, student debt levels, fashion trends, Cubs winning the World Series, etc.).

Do autonomous policies – policies that are constantly learning and updating based upon changing environmental factors – lead to an autonomous business?  Is this the modern math of the Autonomous Business?

Autonomous Policies = Identify à Document à Codify à Automate + AI/MLDL yields Policies that learn and continuously evolve without human intervention

That’s something to consider over a Guinness or three on my next trip to Ireland.

 

Original post: https://www.linkedin.com/pulse/leverage-ai-create-autonomous-policies-adapts-without-bill-schmarzo

49 comentários em “Leverage AI to Create Autonomous Policies that Adapts without Human Intervention

  1. Greate post. Keep writing such kind of information on your blog.
    Im really impressed by your blog.
    Hi there, You have performed a fantastic job. I will definitely digg it and individually suggest to my friends.

    I am confident they’ll be benefited from this web
    site.

  2. I’ll immediately grasp your rss as I can’t find your e-mail subscription link or newsletter service.

    Do you have any? Please permit me recognize in order that I may just
    subscribe. Thanks.

  3. I am the business owner of JustCBD brand (justcbdstore.com) and I am currently trying to broaden my wholesale side of company. I really hope that anybody at targetdomain is able to provide some guidance ! I considered that the most effective way to do this would be to connect to vape shops and cbd stores. I was really hoping if anybody at all could recommend a trustworthy website where I can purchase Vape Shop B2B Companies I am already checking out creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not sure which one would be the most suitable selection and would appreciate any support on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  4. I’m the co-founder of JustCBD Store company (justcbdstore.com) and I am currently planning to develop my wholesale side of business. I am hoping someone at targetdomain share some guidance ! I thought that the most ideal way to accomplish this would be to talk to vape stores and cbd stores. I was really hoping if someone could recommend a reliable web site where I can buy CBD Shops B2B Sales Leads I am presently examining creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not sure which one would be the very best option and would appreciate any support on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  5. That is a really good tip particularly to those fresh to the blogosphere. Brief but very accurate information… Many thanks for sharing this one. A must read post!

  6. Spot on with this write-up, I absolutely feel this website needs a lot more attention. I’ll probably be returning to read more, thanks for the information!

  7. I needed to thank you for this wonderful read!! I definitely enjoyed every little bit of it. I have you saved as a favorite to look at new things you post…

  8. Hello there, I do think your blog may be having internet browser compatibility issues. When I take a look at your web site in Safari, it looks fine however, if opening in I.E., it’s got some overlapping issues. I simply wanted to give you a quick heads up! Besides that, excellent blog!

  9. Hi there! I know this is kinda off topic but
    I was wondering if you knew where I could get a captcha plugin for my comment form?
    I’m using the same blog platform as yours and I’m having difficulty finding one?
    Thanks a lot! adreamoftrains web hosting company

  10. My partner and I stumbled over here coming from a different web
    page and thought I might as well check things out. I like what I see so i
    am just following you. Look forward to exploring your web
    page for a second time.

  11. Hello there! This blog post could not be written any better! Looking at this post reminds me of my previous roommate! He constantly kept preaching about this. I will send this information to him. Fairly certain he’ll have a good read. Thank you for sharing!

  12. I really love your blog.. Excellent colors & theme. Did you create this site yourself? Please reply back as I’m looking to create my own site and would love to find out where you got this from or exactly what the theme is named. Thank you!

  13. Achieving your fitness goal does not need a certified personal trainer or an expensive gym membership, especially when you have the budget and the space to consider practically every workout machine in the market.

  14. An impressive share! I have just forwarded this onto a coworker who was conducting a little research on this. And he in fact ordered me breakfast simply because I stumbled upon it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanx for spending some time to discuss this topic here on your blog.

  15. Having read this I believed it was really enlightening. I appreciate you taking the time and effort to put this article together. I once again find myself personally spending a significant amount of time both reading and posting comments. But so what, it was still worthwhile!

  16. Hi, I do think this is an excellent site. I stumbledupon it 😉 I will revisit once again since i have book marked it. Money and freedom is the greatest way to change, may you be rich and continue to help others.

  17. I’m excited to find this great site. I need to to thank you for ones time just for this fantastic read!! I definitely appreciated every part of it and i also have you bookmarked to check out new things in your website.

  18. I have to thank you for the efforts you have put in penning this blog. I am hoping to check out the same high-grade content from you in the future as well. In fact, your creative writing abilities has motivated me to get my own site now 😉

  19. I’m impressed, I have to admit. Seldom do I come across a blog that’s both equally educative and amusing, and let me tell you, you have hit the nail on the head. The issue is something which not enough men and women are speaking intelligently about. I am very happy that I came across this in my search for something relating to this.

  20. May I simply say what a comfort to discover someone that truly understands what they’re discussing online. You actually realize how to bring a problem to light and make it important. More and more people need to look at this and understand this side of your story. I was surprised that you aren’t more popular since you definitely possess the gift.

  21. I was pretty pleased to discover this website. I want to to thank you for your time due to this fantastic read!! I definitely appreciated every little bit of it and I have you book-marked to look at new things on your web site.

  22. After I initially left a comment I seem to have clicked the -Notify me when new comments are added- checkbox and from now on each time a comment is added I get four emails with the same comment. Perhaps there is a way you are able to remove me from that service? Kudos!

  23. Right here is the perfect site for anyone who hopes to understand this topic. You understand so much its almost hard to argue with you (not that I personally would want to…HaHa). You definitely put a fresh spin on a topic which has been discussed for ages. Great stuff, just great!

  24. Hi, I do think this is an excellent web site. I stumbledupon it 😉 I’m going to revisit yet again since I saved as a favorite it. Money and freedom is the best way to change, may you be rich and continue to guide others.

  25. I seriously love your website.. Very nice colors & theme. Did you create this website yourself? Please reply back as I’m attempting to create my very own website and would like to find out where you got this from or what the theme is called. Thank you!

  26. Hello there! I could have sworn I’ve visited this site before but after browsing through some of the posts I realized it’s new to me. Nonetheless, I’m definitely delighted I discovered it and I’ll be bookmarking it and checking back frequently!

Leave a Reply

Your email address will not be published. Required fields are marked *