A new tool lets artists add invisible changes to the pixels in their art before they upload it online so that if itâs scraped into an AI training set, it can cause the resulting model to break in chaotic and unpredictable ways.Â
The tool, called Nightshade, is intended as a way to fight back against AI companies that use artistsâ work to train their models without the creatorâs permission. Using it to âpoisonâ this training data could damage future iterations of image-generating AI models, such as DALL-E, Midjourney, and Stable Diffusion, by rendering some of their outputs uselessâdogs become cats, cars become cows, and so forth. MIT Technology Review got an exclusive preview of the research, which has been submitted for peer review at computer security conference Usenix.  Â
AI companies such as OpenAI, Meta, Google, and Stability AI are facing a slew of lawsuits from artists who claim that their copyrighted material and personal information was scraped without consent or compensation. Ben Zhao, a professor at the University of Chicago, who led the team that created Nightshade, says the hope is that it will help tip the power balance back from AI companies towards artists, by creating a powerful deterrent against disrespecting artistsâ copyright and intellectual property. Meta, Google, Stability AI, and OpenAI did not respond to MIT Technology Reviewâs request for comment on how they might respond.Â
Zhaoâs team also developed Glaze, a tool that allows artists to âmaskâ their own personal style to prevent it from being scraped by AI companies. It works in a similar way to Nightshade: by changing the pixels of images in subtle ways that are invisible to the human eye but manipulate machine-learning models to interpret the image as something different from what it actually shows.Â
Hi, Tumblr. Itâs Tumblr. Weâre working on some things that we want to share with you.Â
AI companies are acquiring content across the internet for a variety of purposes in all sorts of ways. There are currently very few regulations giving individuals control over how their content is used by AI platforms. Proposed regulations around the world, like the European Unionâs AI Act, would give individuals more control over whether and how their content is utilized by this emerging technology. We support this right regardless of geographic location, so weâre releasing a toggle to opt out of sharing content from your public blogs with third parties, including AI platforms that use this content for model training. Weâre also working with partners to ensure you have as much control as possible regarding what content is used.
Here are the important details:
We already discourage AI crawlers from gathering content from Tumblr and will continue to do so, save for those with which we partner.Â
We want to represent all of you on Tumblr and ensure that protections are in place for how your content is used. We are committed to making sure our partners respect those decisions.
To opt out of sharing your public blogsâ content with third parties, visit each of your public blogsâ blog settings via the web interface and toggle on the âPrevent third-party sharingâ option.Â
For instructions on how to opt out using the latest version of the app, please visit this Help Center doc.Â
Please note: If youâve already chosen to discourage search crawling of your blog in your settings, weâve automatically enabled the âPrevent third-party sharingâ option.
If you have concerns, please read through the Help Center doc linked above and contact us via Support if you still have questions.
I get jumpscared by Tulin all the time. He just pops up out of nowhere and I donât even expect him bc Iâm so used to botwâs mechanics. He lives for it. He lives to scare me.