Researchers detail texture-swapping AI that could be used to create deepfakes

In a preprint paper published on Arxiv.org, researchers at the University of California, Berkeley and Adobe Research describe the Swapping Autoencoder, a machine learning model designed specifically for image manipulation. They claim it can modify any image in a variety ways, including texture swapping, while remaining “substantially” more efficient compared with previous generative models.

The researchers acknowledge that their work could be used to create deepfakes, or synthetic media in which a person in an existing image or video is replaced with someone else’s likeness. In a human perceptual study, subjects were fooled 31% of the time by images created using the Swapping Autoencoder. But they also say that proposed detectors can successfully spot images manipulated by the tool at least 73.9% of the time, suggesting the Swapping Autoencoder is no more harmful than other AI-powered image manipulation tools.

“We show that our method based on an auto-encoder model has a number of advantages over prior work, in that it can accurately embed high-resolution images in real-time, into an embedding space that disentangles texture from structure, and generates realistic output images … Each code in the representation can be independently modified such that the resulting image both looks realistic and reflects the unmodified codes,” the coauthors of the study wrote.

The researchers’ approach isn’t novel in the sense that many AI models can edit portions of images to create new images. For example, the MIT-IBM Watson AI Lab released a tool that lets users upload photographs and customize the appearance of pictured buildings, flora, and fixtures, and Nvidia’s GauGAN can create lifelike landscape images that never existed. But these models tend to be challenging to design and computationally intensive to run.

By contrast, the Swapping Autoencoder is lightweight, using image swapping as a “pretext” task for learning an embedding space useful for image manipulation. It encodes a given image into two separate latent codes — a “structure” code and a “texture” code — intended to represent structure and texture, and during training, the structure code learns to correspond to the layout or structure of a scene while the texture codes capture properties about the scene’s overall appearance.

In an experiment, the researchers trained Swapping Autoencoder on a data set containing images of churches, animal faces, bedrooms, people, mountain ranges, and waterfalls and built a web app that offers fine-grained control over uploaded photos. The app supports global style editing and region editing as well as cloning, with a brush tool that replaces the structure code from another part of the image.

“Tools for creative expression are an important part of human culture … Learning-based content creation tools such as our method can be used to democratize content creation, allowing novice users to synthesize compelling images,” the coauthors wrote.

 

Original post: https://venturebeat.com/2020/07/07/researchers-detail-texture-swapping-ai-that-could-be-used-to-create-deepfakes/

103 comentários em “Researchers detail texture-swapping AI that could be used to create deepfakes

  1. I’m the proprietor of JustCBD Store label (justcbdstore.com) and I’m presently seeking to grow my wholesale side of company. It would be great if anybody at targetdomain can help me . I considered that the most suitable way to accomplish this would be to connect to vape companies and cbd retail stores. I was hoping if anybody could recommend a reliable web site where I can purchase Vape Shop B2B Marketing List I am presently considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. On the fence which one would be the most ideal selection and would appreciate any assistance on this. Or would it be easier for me to scrape my own leads? Ideas?

  2. I am the co-founder of JustCBD brand (justcbdstore.com) and I’m presently aiming to expand my wholesale side of business. I really hope that anybody at targetdomain give me some advice 🙂 I considered that the best way to accomplish this would be to talk to vape stores and cbd retail stores. I was hoping if anybody at all could recommend a qualified web-site where I can get CBD Shops B2B Database I am already considering creativebeartech.com, theeliquidboutique.co.uk and wowitloveithaveit.com. Not exactly sure which one would be the most suitable solution and would appreciate any guidance on this. Or would it be easier for me to scrape my own leads? Ideas?

  3. The next time I read a blog, I hope that it won’t fail me as much as this particular one. I mean, Yes, it was my choice to read, however I truly believed you would probably have something useful to talk about. All I hear is a bunch of whining about something that you can fix if you were not too busy searching for attention.

  4. An outstanding share! I’ve just forwarded this onto a coworker who has been conducting a little homework on this. And he in fact ordered me breakfast due to the fact that I found it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanx for spending time to talk about this subject here on your internet site.

  5. Hello there! This article couldn’t be written much better! Looking through this article reminds me of my previous roommate! He always kept preaching about this. I am going to forward this article to him. Pretty sure he will have a great read. I appreciate you for sharing!

  6. Next time I read a blog, I hope that it won’t fail me just as much as this one. I mean, I know it was my choice to read, nonetheless I really thought you would have something useful to say. All I hear is a bunch of whining about something that you could possibly fix if you weren’t too busy seeking attention.

  7. Your style is so unique compared to other folks I have read stuff from. Thank you for posting when you have the opportunity, Guess I’ll just book mark this site.

  8. Greetings! Very useful advice in this particular article! It is the little changes that make the largest changes. Many thanks for sharing!

  9. Hi there! This article could not be written any better! Looking at this article reminds me of my previous roommate! He constantly kept talking about this. I’ll send this information to him. Pretty sure he will have a very good read. Thank you for sharing!

  10. An impressive share! I’ve just forwarded this onto a friend who had been doing a little homework on this. And he actually bought me dinner because I stumbled upon it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanks for spending some time to talk about this issue here on your web page.

  11. Everything is very open with a really clear clarification of the issues. It was truly informative. Your website is very helpful. Thank you for sharing!

  12. Good site you have got here.. It’s hard to find good quality writing like yours these days. I really appreciate individuals like you! Take care!!

  13. Right here is the perfect site for anybody who wants to find out about this topic. You know a whole lot its almost hard to argue with you (not that I actually would want to…HaHa). You definitely put a new spin on a subject which has been discussed for a long time. Wonderful stuff, just great!

  14. I’m amazed, I have to admit. Rarely do I encounter a blog that’s equally educative and amusing, and let me tell you, you’ve hit the nail on the head. The problem is something too few men and women are speaking intelligently about. Now i’m very happy that I came across this during my hunt for something relating to this.

  15. A motivating discussion is definitely worth comment. I believe that you should publish more on this subject matter, it might not be a taboo matter but generally folks don’t talk about such issues. To the next! Cheers!!

  16. This is the right blog for anybody who would like to understand this topic. You understand so much its almost tough to argue with you (not that I really would want to…HaHa). You certainly put a brand new spin on a topic which has been written about for decades. Great stuff, just excellent!

  17. I blog often and I really appreciate your information. This great article has truly peaked my interest. I will bookmark your site and keep checking for new details about once a week. I opted in for your Feed as well.

  18. I absolutely love your blog.. Excellent colors & theme. Did you build this web site yourself? Please reply back as I’m wanting to create my own website and would like to know where you got this from or just what the theme is named. Thank you!

  19. Spot on with this write-up, I honestly think this amazing site needs a great deal more attention. I’ll probably be returning to read more, thanks for the info!

  20. Hello, There’s no doubt that your blog may be having browser compatibility problems. Whenever I take a look at your website in Safari, it looks fine however, when opening in I.E., it has some overlapping issues. I merely wanted to give you a quick heads up! Apart from that, great blog!

  21. After going over a number of the blog articles on your web page, I honestly like your way of blogging. I bookmarked it to my bookmark webpage list and will be checking back in the near future. Please check out my website as well and tell me what you think.

  22. Your style is very unique in comparison to other folks I’ve read stuff from. Thanks for posting when you have the opportunity, Guess I will just bookmark this page.

  23. Hey very cool website!! Guy .. Beautiful .. Amazing .. I will bookmark your blog and take
    the feeds additionally? I’m glad to search out so many helpful
    info here in the submit, we’d like work out extra techniques
    on this regard, thank you for sharing. . . . . . adreamoftrains content
    hosting

  24. I’d like to thank you for the efforts you have put in writing this
    blog. I’m hoping to check out the same high-grade content from you later on as well.

    In fact, your creative writing abilities has inspired me to
    get my own site now 😉

  25. Hey would you mind sharing which blog platform you’re using?
    I’m looking to start my own blog in the near future but I’m having a tough time making a decision between BlogEngine/Wordpress/B2evolution and Drupal.
    The reason I ask is because your design and style seems different then most
    blogs and I’m looking for something unique.
    P.S Sorry for being off-topic but I had to ask!

  26. I don’t know if it’s just me or if perhaps everybody else
    experiencing problems with your blog. It looks like some of the written text within your content are running off the screen. Can someone else please comment and let me know if this is happening to them as well?
    This might be a issue with my browser because I’ve had this happen previously.
    Many thanks

  27. An outstanding share! I’ve just forwarded this onto a coworker who had been conducting a little research on this. And he in fact ordered me dinner simply because I discovered it for him… lol. So allow me to reword this…. Thank YOU for the meal!! But yeah, thanx for spending time to talk about this matter here on your website.

  28. After looking into a handful of the articles on your blog, I truly appreciate your way of blogging. I saved it to my bookmark website list and will be checking back soon. Please visit my website too and let me know what you think.

  29. You have made some good points there. I checked on the net for additional information about the issue and found most individuals will go along with your views on this site.

  30. You are so cool! I do not suppose I have read a single thing like this before. So wonderful to discover someone with genuine thoughts on this issue. Seriously.. many thanks for starting this up. This site is one thing that’s needed on the internet, someone with a little originality!

  31. An outstanding share! I’ve just forwarded this onto a coworker who was doing a little research on this. And he in fact bought me lunch because I found it for him… lol. So let me reword this…. Thanks for the meal!! But yeah, thanks for spending the time to talk about this subject here on your blog.

  32. Oh my goodness! Amazing article dude! Thank you, However I am encountering problems with your RSS. I don’t understand the reason why I am unable to subscribe to it. Is there anyone else having identical RSS problems? Anybody who knows the answer can you kindly respond? Thanks!!

  33. I’m amazed, I must say. Rarely do I come across a blog that’s both educative and interesting, and without a doubt, you’ve hit the nail on the head. The issue is an issue that not enough men and women are speaking intelligently about. Now i’m very happy I found this in my search for something regarding this.

  34. When I initially left a comment I seem to have clicked the -Notify me when new comments are added- checkbox and now whenever a comment is added I recieve 4 emails with the exact same comment. There has to be an easy method you are able to remove me from that service? Thanks!

  35. After looking over a few of the articles on your website, I truly like your way of blogging. I saved as a favorite it to my bookmark website list and will be checking back in the near future. Please check out my web site too and let me know how you feel.

  36. Howdy! This blog post could not be written any better! Reading through this article reminds me of my previous roommate! He continually kept preaching about this. I most certainly will forward this information to him. Fairly certain he will have a very good read. Thank you for sharing!

  37. Having read this I thought it was very informative. I appreciate you taking the time and effort to put this short article together. I once again find myself personally spending a significant amount of time both reading and posting comments. But so what, it was still worthwhile!

  38. This is the right webpage for everyone who would like to find out about this topic. You know a whole lot its almost tough to argue with you (not that I actually will need to…HaHa). You certainly put a brand new spin on a subject which has been discussed for ages. Excellent stuff, just wonderful!

  39. Good post. I learn something totally new and challenging on sites I stumbleupon everyday. It will always be useful to read articles from other authors and practice a little something from their sites.

  40. After looking into a few of the articles on your website, I honestly appreciate your technique of writing a blog. I bookmarked it to my bookmark site list and will be checking back soon. Take a look at my website as well and tell me how you feel.

  41. After exploring a number of the articles on your website, I honestly appreciate your technique of blogging. I added it to my bookmark website list and will be checking back in the near future. Take a look at my web site as well and tell me what you think.

  42. An outstanding share! I’ve just forwarded this onto a friend who has been doing a little homework on this. And he in fact ordered me lunch due to the fact that I discovered it for him… lol. So let me reword this…. Thank YOU for the meal!! But yeah, thanks for spending some time to discuss this topic here on your internet site.

  43. You’re so awesome! I do not suppose I’ve truly read a single thing like this before. So great to find another person with a few original thoughts on this subject matter. Seriously.. thanks for starting this up. This web site is one thing that is required on the internet, someone with some originality!

  44. Aw, this was an incredibly nice post. Taking the time and actual effort to produce a top notch article… but what can I say… I put things off a lot and don’t seem to get anything done.

  45. Achieving your fitness goals doesn’t have to require a certified personal trainer or an expensive gym membership, it is not hard to exercise at home. It’s easy to go down a training and fitness rabbit hole, however, when you are looking for the best home exercise equipment to outfit your personal home gym.

  46. It is the best time to make some plans for the
    future and it’s time to be happy. I’ve read this
    post and if I could I wish to suggest you few interesting things
    or advice. Maybe you can write next articles referring to this article.

    I wish to read even more things about it! 34pIoq5 cheap flights

  47. After I originally left a comment I seem to have clicked on the -Notify me when new comments are added- checkbox and from now on whenever a comment is added I get four emails with the exact same comment. Is there a means you can remove me from that service? Thank you!

  48. Howdy! This post could not be written any better! Looking at this post reminds me of my previous roommate! He continually kept talking about this. I am going to forward this post to him. Pretty sure he will have a great read. Thanks for sharing!

  49. Howdy! I could have sworn I’ve visited your blog before but after looking at many of the articles I realized it’s new to me. Anyhow, I’m certainly happy I stumbled upon it and I’ll be bookmarking it and checking back regularly!

  50. When I originally commented I seem to have clicked on the -Notify me when new comments are added- checkbox and from now on every time a comment is added I get four emails with the same comment. There has to be an easy method you can remove me from that service? Thanks!

  51. Hi there, There’s no doubt that your website may be having internet browser compatibility issues. Whenever I take a look at your website in Safari, it looks fine however when opening in Internet Explorer, it’s got some overlapping issues. I merely wanted to give you a quick heads up! Besides that, fantastic website!|

  52. An interesting discussion is definitely worth comment. There’s no doubt that that you ought to write more on this issue, it may not be a taboo subject but generally people don’t speak about these subjects. To the next! Kind regards!!

  53. Can I simply say what a relief to discover someone who really understands what they are discussing on the internet. You actually realize how to bring a problem to light and make it important. More and more people should read this and understand this side of the story. I was surprised that you are not more popular because you definitely have the gift.

  54. Oh my goodness! Impressive article dude! Thank you so much, However I am encountering difficulties with your RSS. I don’t understand the reason why I can’t join it. Is there anybody else having the same RSS problems? Anybody who knows the answer can you kindly respond? Thanks!!

  55. Pretty component of content. I just stumbled upon your blog and in accession capital to say that I acquire actually loved account your blog posts. Anyway I will be subscribing for your augment or even I success you get right of entry to persistently fast.

  56. Hi there just wanted to give you a quick heads up and let you know a few of the images aren’t loading properly. I’m not sure why but I think its a linking issue. I’ve tried it in two different web browsers and both show the same results.

  57. Hello, I think your site might be having browser compatibility issues. When I look at your blog site in Ie, it looks fine but when opening in Internet Explorer, it has some overlapping. I just wanted to give you a quick heads up! Other then that, very good blog!

  58. I’ll right away grasp your rss feed as I can not find your email subscription hyperlink or e-newsletter service. Do you’ve any? Kindly allow me understand in order that I could subscribe. Thanks.

  59. I am really impressed with your writing skills as well as with the layout on your blog. Is this a paid theme or did you customize it yourself? Either way keep up the excellent quality writing, it is rare to see a great blog like this one these days..

  60. Please let me know if you’re looking for a writer for your blog. You have some really great articles and I think I would be a good asset. If you ever want to take some of the load off, I’d love to write some content for your blog in exchange for a link back to mine. Please blast me an e-mail if interested. Many thanks!

  61. Youre so cool! I dont suppose Ive learn something like this before. So nice to search out anyone with some unique thoughts on this subject. realy thank you for starting this up. this website is something that is needed on the net, someone with a bit of originality. helpful job for bringing one thing new to the internet!

Leave a Reply

Your email address will not be published. Required fields are marked *