MIT researchers train AI to predict how humans paint works of art

MIT researchers have created an AI tool capable of generating time-lapse videos that predict how human artists use their hands to create watercolor or digital paintings. The AI is trained using time-lapse videos of people making art on Vimeo and YouTube. The probabilistic model can synthesize and predict moments in the painting process from just a single image of an artwork.

 

The network is meant to mimic the ability skilled human artists possess to see a piece of art and comprehend the series of brush strokes or steps a person took to put it together.

“Artists paint using unique combinations of brushes, strokes, and colors. There are often many possible ways to create a given painting. Our goal is to learn to capture this rich range of possibilities,” researchers wrote in a paper describing the AI.

The authors characterize their work as distinct from other forms of precognitive AI that predict future frames in a video because others tend to focus on physical processes like a flower blooming or human movement and make predictions over relatively short time frames.

The data set contains 117 digital painting time-lapse videos, averaging four minutes long, and 116 time-lapse watercolor painting videos, averaging 20 minutes each. Both data sets focus on landscape and still life paintings.

Roughly 150 human evaluators were hired from Amazon’s Mechanical Turk as part of the experiment to compare video generated by MIT’s model with visual deprojection, a method for recovering missing frames from videos introduced at the Conference on Computer Vision and Pattern Recognition (CVPR) in 2019.

“We show that human evaluators almost always prefer our method to an existing video synthesis baseline and often find our results indistinguishable from time-lapses produced by real artists,” the paper reads. “To the best of our knowledge, this is the first work that models and synthesizes distributions of videos of the past, given a single final frame.”

The frame interpolation method predicts the next sequence in generated time-lapse videos, as well as various AI style transfer techniques. To curate video data sets, a convolutional neural network removes any frames that include hands, paintbrushes, and shadows.

In other CVPR news, earlier today Microsoft CEO Satya Nadella reiterated the need for facial recognition regulation in prerecorded remarks, following the company’s commitment last week to not sell the technology until federal regulation is introduced. A precognition workshop showcasing AI that predicts events based on visual data — like MIT’s painting predictor — will take place Friday at CVPR 2020.

 

Original post: https://venturebeat.com/2020/06/17/mit-researchers-train-ai-to-predict-how-humans-paint-works-of-art/

107 comentários em “MIT researchers train AI to predict how humans paint works of art

  1. Spot on with this write-up, I really think this web site needs far more attention.
    I’ll probably be returning to see more, thanks for the advice!

  2. With havin so much content do you ever run into any problems of
    plagorism or copyright infringement? My website
    has a lot of exclusive content I’ve either created myself or outsourced but it seems a
    lot of it is popping it up all over the web without my permission. Do you know any
    ways to help stop content from being stolen? I’d truly appreciate it.

  3. I like the valuable info you provide in your articles. I’ll bookmark your
    blog and check again here frequently. I am quite sure I will learn lots
    of new stuff right here! Good luck for the next!

  4. Great work! That is the kind of information that are meant to be shared around the
    internet. Disgrace on Google for no longer positioning this put up higher!
    Come on over and consult with my website .
    Thanks =)

  5. Hi! I’m at work browsing your blog from my new iphone 3gs!
    Just wanted to say I love reading your blog and look forward to all your posts!
    Carry on the fantastic work!

  6. Greetings, I do believe your site might be having browser compatibility problems.
    Whenever I take a look at your website in Safari, it looks fine however when opening in Internet Explorer, it’s got some overlapping issues.
    I merely wanted to give you a quick heads up!
    Apart from that, great site!

  7. I was curious if you ever thought of changing the structure of
    your blog? Its very well written; I love what youve got to
    say. But maybe you could a little more in the way of
    content so people could connect with it better. Youve
    got an awful lot of text for only having 1 or 2 images. Maybe you could space it out better?

  8. I am the manager of JustCBD Store label (justcbdstore.com) and I am currently looking to broaden my wholesale side of company. I am hoping anybody at targetdomain is able to provide some guidance ! I considered that the very best way to accomplish this would be to connect to vape shops and cbd retailers. I was hoping if anyone could recommend a reputable website where I can purchase Vape Shop B2B Sales Leads I am currently taking a look at creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the very best choice and would appreciate any guidance on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  9. After I originally left a comment I appear to have clicked the -Notify me when new comments are added- checkbox and now each time a comment is added I receive 4 emails with the exact same comment. There has to be a means you are able to remove me from that service? Thanks!

  10. Aw, this was an incredibly good post. Finding the time and actual effort to produce a very good article… but what can I say… I put things off a lot and don’t manage to get anything done.

  11. Great blog! Is your theme custom made or did you download it from somewhere?

    A theme like yours with a few simple adjustements would really make my blog shine.
    Please let me know where you got your theme.
    Cheers

  12. When I initially left a comment I seem to have clicked on the -Notify me when new comments are added- checkbox and from now on each time a comment is added I receive four emails with the exact same comment. Perhaps there is an easy method you are able to remove me from that service? Cheers!

  13. Your style is really unique in comparison to other folks I have read stuff from. I appreciate you for posting when you have the opportunity, Guess I will just bookmark this site.

  14. Aw, this was a very good post. Spending some time and actual effort to produce a great article… but what can I say… I hesitate a lot and never seem to get nearly anything done.

  15. I blog quite often and I truly thank you for your information. This great article has truly peaked my interest.
    I’m going to bookmark your site and keep checking for new details about once a
    week. I opted in for your RSS feed as well.

  16. Can I just say what a comfort to discover somebody that genuinely knows what they are talking about on the internet. You actually understand how to bring an issue to light and make it important. A lot more people really need to check this out and understand this side of the story. I can’t believe you are not more popular given that you certainly have the gift.

  17. An intriguing discussion is worth comment. I do believe that you ought to write more about this subject, it may not be a taboo matter but generally folks don’t speak about these topics. To the next! Kind regards!!

  18. Greetings, I believe your website may be having browser compatibility problems. When I look at your blog in Safari, it looks fine however when opening in IE, it’s got some overlapping issues. I just wanted to give you a quick heads up! Aside from that, wonderful site!

  19. An intriguing discussion is definitely worth comment. There’s no
    doubt that that you need to publish more on this subject matter, it may not be a taboo
    matter but typically folks don’t talk about these topics.
    To the next! All the best!! adreamoftrains website host

  20. An intriguing discussion is definitely worth comment. I think that you should write more about this issue, it might not be a taboo subject but generally folks don’t speak about such subjects. To the next! Cheers!!

  21. hey there and thank you for your information – I have certainly picked up something new from right
    here. I did however expertise several technical points using this web site, since I experienced to
    reload the web site lots of times previous to I could get
    it to load correctly. I had been wondering if your hosting is OK?

    Not that I’m complaining, but slow loading instances times will often affect your
    placement in google and could damage your high-quality score if advertising
    and marketing with Adwords. Well I’m adding this
    RSS to my email and can look out for a lot more of your respective interesting content.
    Make sure you update this again very soon.

  22. Howdy! This blog post could not be written much better! Reading through this article reminds me of my previous roommate! He continually kept talking about this. I will send this article to him. Fairly certain he’s going to have a good read. Many thanks for sharing!

  23. Right here is the perfect website for anybody who really wants to find out about this topic. You realize a whole lot its almost tough to argue with you (not that I actually will need to…HaHa). You certainly put a new spin on a topic that has been written about for years. Excellent stuff, just excellent!

  24. Hi, I do believe this is an excellent blog. I stumbledupon it 😉 I may revisit once again since I saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to guide others.

  25. Everything is very open with a really clear clarification of the challenges. It was really informative. Your website is very useful. Thank you for sharing!

  26. Hi, I do believe this is a great site. I stumbledupon it 😉 I’m going to return once again since i have saved as a favorite it. Money and freedom is the greatest way to change, may you be rich and continue to help others.

  27. I’m impressed, I must say. Rarely do I come across a blog that’s equally educative and entertaining, and without a doubt, you’ve hit the nail on the head. The issue is something which not enough folks are speaking intelligently about. Now i’m very happy I found this in my search for something concerning this.

  28. Aw, this was a very good post. Taking a few minutes and actual effort to create a good article… but what can I say… I hesitate a lot and don’t manage to get anything done.

  29. The very next time I read a blog, Hopefully it doesn’t fail me just as much as this one. I mean, Yes, it was my choice to read, but I truly thought you would probably have something helpful to say. All I hear is a bunch of moaning about something that you could possibly fix if you weren’t too busy seeking attention.

  30. I’m excited to discover this web site. I want to to thank you for your time for this particularly fantastic read!! I definitely liked every part of it and i also have you book-marked to check out new things in your web site.

  31. Howdy, i read your blog from time to time and i own a
    similar one and i was just curious if you get a lot of spam feedback?

    If so how do you stop it, any plugin or anything you
    can recommend? I get so much lately it’s driving me crazy so any help is very much appreciated.

  32. An impressive share! I’ve just forwarded this onto a friend who was doing a little research on this. And he in fact ordered me dinner due to the fact that I discovered it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanks for spending the time to talk about this subject here on your blog.

  33. You’re so interesting! I don’t suppose I’ve read through a single thing like that before. So wonderful to discover somebody with a few genuine thoughts on this topic. Really.. thanks for starting this up. This website is one thing that’s needed on the internet, someone with some originality!

  34. Hi there! I just wanted to ask if you ever have any issues with hackers?

    My last blog (wordpress) was hacked and I ended up losing several weeks of hard work due to no backup.
    Do you have any methods to stop hackers?

  35. Hi there! I know this is kinda off topic but I’d figured I’d ask.
    Would you be interested in exchanging links or maybe guest authoring a blog article or vice-versa?
    My website covers a lot of the same subjects as yours and I think we could greatly benefit from each
    other. If you happen to be interested feel
    free to shoot me an email. I look forward to hearing from you!
    Terrific blog by the way!

  36. May I simply say what a relief to discover somebody that actually knows what they’re talking about on the net. You actually understand how to bring a problem to light and make it important. More and more people must read this and understand this side of your story. It’s surprising you aren’t more popular since you surely have the gift.

  37. Your style is unique in comparison to other people I have read stuff from. Thanks for posting when you’ve got the opportunity, Guess I will just bookmark this blog.

  38. Can I just say what a relief to uncover somebody that actually knows what they are talking about on the web. You certainly realize how to bring a problem to light and make it important. More people have to check this out and understand this side of the story. It’s surprising you’re not more popular because you certainly possess the gift.

  39. Oh my goodness! Amazing article dude! Many thanks, However I am experiencing problems with your RSS. I don’t understand why I am unable to subscribe to it. Is there anybody else getting the same RSS issues? Anybody who knows the answer can you kindly respond? Thanks!!

  40. This is the perfect website for anyone who wants to understand this topic. You realize so much its almost tough to argue with you (not that I really would want to…HaHa). You definitely put a brand new spin on a topic which has been written about for ages. Excellent stuff, just excellent!

  41. After I initially left a comment I appear to have clicked the -Notify me when new comments are added- checkbox and now every time a comment is added I recieve 4 emails with the same comment. There has to be a means you can remove me from that service? Many thanks!

  42. Hi there! This post couldn’t be written much better! Looking through this article reminds me of my previous roommate! He continually kept talking about this. I’ll forward this article to him. Pretty sure he’s going to have a great read. I appreciate you for sharing!

  43. I really love your website.. Pleasant colors & theme. Did you make this web site yourself? Please reply back as I’m wanting to create my own personal site and would like to find out where you got this from or exactly what the theme is named. Kudos!

  44. Wow that was odd. I just wrote an extremely long comment but after I clicked submit my comment didn’t show up. Grrrr… well I’m not writing all that over again. Anyways, just wanted to say wonderful blog!|

  45. Can I just say what a comfort to find somebody that genuinely understands what they are talking about over the internet. You definitely know how to bring an issue to light and make it important. More people need to read this and understand this side of your story. I can’t believe you aren’t more popular given that you surely possess the gift.

  46. I truly love your website.. Excellent colors & theme. Did you build this site yourself? Please reply back as I’m looking to create my own personal site and would love to learn where you got this from or what the theme is called. Many thanks!

  47. You are so cool! I do not suppose I have read something like that before. So great to discover somebody with some original thoughts on this issue. Really.. thanks for starting this up. This site is one thing that’s needed on the internet, someone with a bit of originality!

  48. I truly love your website.. Very nice colors & theme. Did you create this website yourself? Please reply back as I’m looking to create my own site and want to know where you got this from or what the theme is called. Kudos!

  49. I’ll right away clutch your rss feed as I can’t in finding your e-mail subscription link or newsletter service. Do you have any? Please let me recognise in order that I may just subscribe. Thanks.|

  50. Achieving your fitness goals does not have to require a certified personal trainer or an expensive gym membership, it’s not hard to exercise at home. It is easy to go down a training and fitness rabbit hole, however, when you are looking for the best home exercise equipment to outfit your personal home gym.

  51. I must thank you for the efforts you’ve put in penning this website. I’m hoping to see the same high-grade blog posts by you later on as well. In fact, your creative writing abilities has motivated me to get my very own site now 😉

  52. Spot on with this write-up, I seriously believe this amazing site needs a lot more attention. I’ll probably be returning to read through more, thanks for the information!

  53. An outstanding share! I have just forwarded this onto a coworker who had been doing a little research on this. And he actually ordered me dinner simply because I discovered it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanks for spending time to talk about this issue here on your blog.

  54. An outstanding share! I have just forwarded this onto a co-worker who had been doing a little research on this. And he actually ordered me breakfast simply because I found it for him… lol. So let me reword this…. Thanks for the meal!! But yeah, thanks for spending time to talk about this topic here on your web site.

  55. I absolutely love your blog.. Excellent colors & theme. Did you build this site yourself? Please reply back as I’m wanting to create my very own site and would love to learn where you got this from or just what the theme is named. Thanks!

  56. Hi, I do think this is a great website. I stumbledupon it 😉 I may revisit yet again since I bookmarked it. Money and freedom is the best way to change, may you be rich and continue to guide other people.

  57. You’re so interesting! I do not think I’ve truly read something like that before. So wonderful to find another person with a few genuine thoughts on this subject matter. Seriously.. many thanks for starting this up. This site is something that is needed on the web, someone with a bit of originality!

Leave a Reply

Your email address will not be published. Required fields are marked *