CHATGPT WILL START HIDING AN INVISIBLE MARK IN EVERYTHING IT WRITES FOR YOU
openai just confirmed it. its called textGrain and it hits chatgpt and codex in the EU over the next few weeks, because the EU AI Act forces it
you wont see anything. no weird symbols, no hidden characters. the model just picks its words in a slightly patterned way, and a detector can read that pattern later
what it can tell: "was this likely written by an openai model"
what it cant tell: who you are, your account, your prompt
the funny part is openai itself says it barely holds up:
-> short paragraph: caught about 80% of the time
-> change 1 in 10 words: detection drops from 92% to 66%
-> change 1 in 4 words: 17%
-> translate it or rewrite it: the mark can disappear completely
the scariest part isnt the watermark. its who actually gets caught
anyone who edits a little walks free. the kid who copy pastes a full essay without touching a word is the one it catches. and only "approved researchers" get the detector for now, so you cant even check your own text
to be fair, openai isnt hiding any of this. they published the weak numbers themselves, API users anywhere can switch it on today, and they say theyll open source it
personally i think this is bigger than a watermark. europe gets a chatgpt that marks its text, america doesnt. same AI, different rules depending on where you open it
and this is just the first law. there will be more
显示更多
We're expanding our approach to content provenance to include text in response to EU regulatory requirements, while recognizing the significant limitations of current text watermarking technology.
Our tools already help verify whether an image or audio file was created with our models. This work builds on those efforts to help people better understand when content may have been generated or edited with an OpenAI model.
In the EU, we’ll start watermarking eligible text from ChatGPT and Codex over the coming weeks to comply with the EU AI Act.
Customers using our API can turn on text watermarking for select models worldwide today.
显示更多