Experimental New AI Can Autocomplete Images With the Same Technology as Predictive Text

Just as the artificial intelligence in your iPhone can guess the next word you might type in a message, the same technology can predict the bottom half of an image simply from scanning the top half.

That was the finding of a new experiment from research group OpenAI, which trained a version of its hyper-sophisticated text generator, GPT-2, on millions of images to prove that it could generate coherent patterns of pixels in the same manner that it does sentences.

Researchers demonstrated the results by feeding the system the top halves of images like movie posters, sports photos and popular memes. The system was then able to generate a bottom half based on the patterns of pixels it saw. While the results didn’t always match the original image, the output was usually photorealistic and fit seamlessly with the rest of the image.

ImageGPT’s various autocomplete generations based on the top half of a real image on the far right.

The research could help scientists better understand the parallels between how machines understand and generate language versus visual data. While a model of machine learning called a transformer has spurred a new research boom in the subfield of natural language processing AI in the past couple of years, the method has not proven as successful with tasks like image classification and generation, the researchers write in the introduction to their paper.

“Our work aims to understand and bridge this gap,” they said.


AI image generation technology has also made strides in recent years—even spawning a flourishing experimental art scene—but the model of machine learning that has provided the foundation for that research is fundamentally different from that which OpenAI uses in this paper. Most image-producing AI relies on a model called a Generative Adversarial Network (GAN) that can produce varied imitations of a style of image once trained on a large dataset of similar visuals.

OpenAI’s model, dubbed Image GPT, is based instead on a version of GPT-2, which can generate realistic-sounding copy based on a text prompt. OpenAI made waves when it announced GPT-2 early last year and declined to release the code all at once for fear that it would supercharge fake news and spam mass production. Instead, the model has been more often used for novelty applications, like a text-based adventure game, parody Twitter accounts and Adweek’s own Super Bowl Bot.

OpenAI recently released an even larger form of that program called GPT-3, trained on a dataset more than 100 times bigger than the previous iteration, and plans to use it as the backbone of its first commercial product.


Original post: https://www.adweek.com/creativity/experimental-new-ai-can-autocomplete-images-with-the-same-technology-as-predictive-text/

32 comentários em “Experimental New AI Can Autocomplete Images With the Same Technology as Predictive Text

  1. I am the manager of JustCBD Store label (justcbdstore.com) and I’m presently planning to grow my wholesale side of business. I really hope that anybody at targetdomain is able to provide some guidance 🙂 I considered that the best way to do this would be to connect to vape shops and cbd retail stores. I was really hoping if anybody at all could suggest a reliable web-site where I can purchase CBD Shops BUSINESS DATA I am presently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the most ideal option and would appreciate any guidance on this. Or would it be much simpler for me to scrape my own leads? Suggestions?

  2. I am the co-founder of JustCBD company (justcbdstore.com) and I am currently looking to grow my wholesale side of business. I really hope that someone at targetdomain can help me 🙂 I considered that the very best way to accomplish this would be to connect to vape companies and cbd retailers. I was hoping if anyone could recommend a trusted site where I can get Vape Shop B2B Leads I am currently reviewing creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Unsure which one would be the best solution and would appreciate any advice on this. Or would it be simpler for me to scrape my own leads? Suggestions?

  3. This is the right web site for anyone who would like to understand this topic. You know a whole lot its almost tough to argue with you (not that I really will need to…HaHa). You definitely put a new spin on a subject that has been written about for years. Wonderful stuff, just great!

  4. Hi there! I could have sworn I’ve visited this web site before but after browsing through some of the posts I realized it’s new to me. Anyhow, I’m definitely pleased I stumbled upon it and I’ll be book-marking it and checking back often!

  5. Hi, I do believe this is an excellent site. I stumbledupon it 😉 I may revisit yet again since I book-marked it. Money and freedom is the greatest way to change, may you be rich and continue to guide other people.

  6. I really love your site.. Pleasant colors & theme. Did you build this website yourself? Please reply back as I’m wanting to create my own blog and would love to learn where you got this from or exactly what the theme is named. Appreciate it!

  7. Excellent beat ! I wish to apprentice while you amend your web site,
    how can i subscribe for a blog web site? The account aided me a acceptable deal.
    I had been a little bit acquainted of this your broadcast provided bright clear concept

  8. What’s Taking place i am new to this, I stumbled upon this
    I’ve found It positively useful and it has aided me out
    loads. I’m hoping to give a contribution & assist other customers like its aided me.
    Good job.

  9. I am curious to find out what blog system you are utilizing?
    I’m having some small security problems with my latest blog and I’d like
    to find something more safe. Do you have any suggestions?

  10. Its like you read my mind! You appear to know so much about this, like you wrote the book in it
    or something. I think that you can do with a few pics to
    drive the message home a bit, but instead of that,
    this is wonderful blog. A fantastic read. I will certainly be back.
    y2yxvvfw cheap flights

  11. Hello There. I discovered your weblog the usage of msn. That is an extremely smartly written article.
    I will make sure to bookmark it and return to read more of your helpful
    info. Thank you for the post. I’ll certainly comeback.
    cheap flights 2CSYEon

  12. I got this web page from my friend who informed me concerning this web
    page and now this time I am browsing this website and reading very informative content at this time.

    cheap flights yynxznuh

  13. I enjoy what you guys tend to be up too. This type
    of clever work and reporting! Keep up the excellent works guys I’ve added you guys to my blogroll.
    2CSYEon cheap flights

  14. After checking out a number of the blog posts on your site, I seriously like your way of blogging. I saved it to my bookmark webpage list and will be checking back soon. Take a look at my website too and let me know your opinion.

  15. Can I just say what a comfort to uncover someone that truly understands what they are talking about on the internet. You actually understand how to bring a problem to light and make it important. More people have to read this and understand this side of the story. I was surprised you aren’t more popular given that you surely possess the gift.

  16. I just want to say I am all new to blogs and honestly loved you’re web site. Likely I’m going to bookmark your blog . You definitely come with remarkable stories. Appreciate it for revealing your blog site.

Leave a Reply

Your email address will not be published. Required fields are marked *