🦔Someone is buying Japanese used books by the ton. Not novels or comics. Philosophy, history, medical law, Edo-period cultural texts. Multiple buyer accounts all ship to one logistics center in Okayama Prefecture that won't answer questions. Export records show over 50 tons, roughly 100,000 volumes, shipped to the US since last year. No buyer has been identified.
Separately, court documents confirmed Anthropic's "Project Panama" bought millions of books in the US, cut the spines off, scanned them, and shredded the originals. An internal memo said the goal was to "destructively scan all the books in the world." Similar operations have been reported across Europe.
My Take
Anthropic's US book operation came out in court filings earlier this year. Project Panama. Millions of books, cut the spines off, scanned, shredded. Their VP chose the codename so nobody outside the company would find out. That story broke and apparently the same operation just moved to Japan. Anonymous buyer accounts, a warehouse in Okayama that won't take questions, and 100,000 volumes of specialized academic texts that nobody buys to resell.
I don't know how you build a trillion-dollar industry on material you had to acquire in secret through middlemen because you knew the public would object. Authors spent years on those books and now they're fed through a scanner and thrown away so a chatbot can sound smarter. If the data was free to use, they wouldn't need codenames and anonymous warehouses. The lawsuits over who owns this material have barely begun and I think the copyright exposure across the whole AI industry is enormous. Anthropic's internal memo said the goal was every book in the world, which describes the foundation of the product.
Hedgie🤗
显示更多
My dear friends, I am happy to report the publication of the most important paper in my life to date (we have several great papers coming out but this is very special). Tomorrow, I will present this paper for the first time at the Nature AI Healthcare in Paris and will post a longer post on this story and its broader implications for how to conduct clinical trials. Please read it and comment on it.
Many thanks to the great co-authors of the study and everyone who contributed. Many thanks to the many reviewers (friendly and unfriendly) for spending so much time and helping make it better.
Link in the comments.
显示更多
Introducing Expert Intelligence ✨
A cross-
@Google initiative that helps you engage with your trusted sources, starting with eligible
@GooglePlay ebooks in Gemini Notebook. You can now combine expertise from your favorite authors with other sources and engage with your books in brand new ways!
Try it out here:
显示更多
This Melbourne bookstore “Amplify” only stocks non-white authors.
So I went there to ask if I could get a book in their store as somebody of Greek Cypriot ancestry.
Unfortunately she told me that they could not sell my book as I was too white for the store.
Shocking new developments in race science
显示更多
The word "steampunk" was coined in April 1987 by American science fiction writer K. W. Jeter.
He proposed it jokingly in a letter to *Locus* magazine to describe the alternate-history novels set in the 19th century that he was writing alongside his fellow authors Tim Powers and James Blaylock.
显示更多
Claude's watermark probably doesn't work how you think. As the CTO of GPTZero, I'll explain how Anthropic, Google and OpenAI are building text watermarking in this brief explainer and whether it can be defeated.
Almost all forms of watermarking that are fast and cheap enough for a frontier lab have the same formula, following the KGW method:
In generation:
1. Let's say you've generated n tokens so far. Take those n tokens + a secret key to generate a random hash
2. Use that hash to randomly reweight the probabilities for the n+1 token, and then sample from that new distribution. In the simple case, you could split 50% of all English words into a green or red set based on your hash, and boost the probability of words in the green set.
For watermark detection:
1. For each token, see if it was in the green or red set.
2. To do this, recreate the hash based on the secret key and the text preceding the current token. Then, recreate the green and red set of words.
3. Once you've checked all the words in the text, if the next token is selected disproportionally from the green set more than 50% of the time, you claim the text has the watermark.
I can tell you want to ask the following:
1) Isn't it easy to mess up the hash if you paraphrase the text? The answer is mostly yes, however, you can use a statistical model to get your hash instead of a deterministic function (SIR, Adaptive Watermark). Since the entire watermark is probabilistic, this is fine.
2) Doesn't this make the text much worse? The answer is yes, it does - Yes, it does – but for most people, it's imperceptible (Google claims in human feedback study with 20,000 texts), since there are exponentially many ways to write the same paragraph. DiPmark does something more sophisticated to avoid shifting the text distribution on average. Of course, watermarks fail on short text or highly predictable texts like "2+2=4".
3) Shouldn't it be easy to figure out the green and red sets? The answer is no. You would need an exponentially large number of samples from the watermarker to reconstruct those sets exactly, but it's a risk if the detector is open to the wild (Watermark Stealing)
Still, there are couple challenges that a frontier lab needs to overcome:
1. Their watermark needs to work token-by-token because they are streaming their text to users. Many watermark methods plan sentences or paragraphs at a time, or change the text after its entirely written, in order to make their watermark robust to paraphrasers, and a frontier lab cannot afford to do this yet (SemStamp, PostMark)
2. If the secret key leaks, the watermark is busted. To avoid a large blast damage from this, you need to have a couple secret keys in rotation.
3. There are some texts, like code, that cannot be arbitrarily changed, otherwise the code will break. In those cases, the watermark needs to selectively change words in parts of the text that can tolerate synonyms (i.e. like variable naming) - see SWEET, EWD, Invisible Entropy.
4. They will need to educate their users on how to deal with false positives and false negatives of a detector, which is a big challenge (one we put a lot of effort into)
So, how do I see this playing out in the next 6 months?
1. If Anthropic releases the watermark detector publically, I think they defeat their own watermark. People find reliable watermark removal strategies by testing against Anthropic (AI detectors like GPTZero have an advantage here because they can train against these adversaries once they become popular).
2. If they keep the detector private to the government, like Google has done, it's "safer". However, there are some papers showing trained approaches that work robustly to zero-shot break watermarks without any data, simply because they try to write the text just like a human (Zhang et al. 2024, Watermarks in the Sand). Also, making your detector makes it battle-tested and stronger long-term (my experience).
3. In my testing, the watermarks don't survive intense paraphrasing (especially if you combine word choice and syntax attacks), or human text substitution (rewrite your AI text by plagiarizing human authors). The free paraphrasers I've tried have quickly bypassed Google Deepmind's SynthId for what it's worth.
4. All-in-all, frontier labs are likely okay with this because they expect most users to not attack the watermark, and also because they + European regulators likely don't care past a certain point - its good enough.
5. Overall, I think users of frontier LLMs will not really care about this, because 1) they don't realize watermarks are there, 2) EU will force everyone to conform, 3) this seems more like regulatory hoop-jumping than an earnest effort from frontier labs to expose LLM use
Lastly, people's first concern shouldn't be watermarking, it should be AI detectors!
If you're posting, "its not X, its Y!!", I don't think the watermark is going to make a difference :)
显示更多
RAG system that skips HTML parsing entirely!
PixelRAG is an open-source visual RAG framework that renders documents as screenshots instead of parsing them into text.
Most RAG pipelines start by converting HTML to text. Tables flatten into unstructured rows. Charts disappear. Layout context is gone before the LLM ever sees it. The paper measured this directly: HTML-to-text conversion accounts for 36.6% of retrieval failures on SimpleQA.
PixelRAG skips that step entirely. It renders pages as screenshot tiles using Playwright, embeds those tiles with a fine-tuned Qwen3-VL-Embedding model, builds a FAISS index, and passes retrieved images directly to a VLM reader. No text abstraction in between.
Benchmarked across six datasets against the strongest text-based baselines:
- SimpleQA: 78.8% vs 71.6% (+7.1 points)
- NQ-Tables: 48.8% vs 42.5% (+6.3 points)
- EVQA: +15.5 points
- LiveVQA: +11.3 points
One honest caveat from the authors: this requires Qwen3-VL-4B class models or larger to see the benefit. Smaller models trail text retrieval. The authors also recommend using PixelRAG as an enhancement layer alongside existing text systems rather than a full replacement.
Ships with a pre-built Wikipedia index covering 8.28M articles across 28.1M screenshot tiles. A Claude Code plugin lets Claude take screenshots of any URL and reason over the visual content directly.
Key capabilities:
• Renders web pages, PDFs, and images as screenshot tiles via Playwright
• Fine-tuned Qwen3-VL-Embedding model for visual retrieval
• FAISS index for fast vector search
• Pre-built Wikipedia index: 8.28M articles, 28.1M tiles
• 3x token cost reduction via image compression
• Claude Code plugin for direct URL screenshot and visual reasoning
• LoRA fine-tuning support via pixelrag-train
100% open source.
I've shared the link in the replies!
显示更多
🚨 Thrilled to share that our lab will be presenting the 🏆 Best Paper at the NExT-Game Workshop at #
ICML2026# today!
🎤 When Agents Lie: Premeditation, Persistence, and Exploitation in Repeated Games
🏆 Best Paper @ NExT-Game Workshop
📍 Conference Room S307
📅 Fri, Jul 10
🕐 13:00–13:20 KST
Authors:
@JerickShi @TerryJCZhang @bschoelkopf @conitzer @ZhijingJin
🤖 We introduce a three-stage endogenous promise protocol for repeated multi-agent games that asks not only whether LLM agents honor their public commitments when they can privately deviate, but also how model-on-model composition influences premeditated deception and persistent exploitation.
📊 Across six canonical games spanning binary and numerical action spaces, our evaluation of frontier models (GPT-5.2, Llama-4-Maverick, Claude-Opus-4.6) reveals:
🔹 Over 90% of promise-breaking instances are premeditated in agents' private plans.
🔹 Mixed-model groups with mismatched communication frameworks create systemic, persistent payoff gaps of up to 5.00 points from Round 0.
📄 Paper:
#
MultiAgentSystems# #
LLMs# #
GameTheory# #
AI# #
ICML2026#
显示更多
📣 We are presenting 6 main conference papers 🚀and 14 workshop papers (including 🏆2 Best Papers🏆) at #
ICML2026# in Korea! Also hosting one of the largest workshops, Trustworthy AI for Good, on July 10th 🌍❤️.
We push the frontiers on #
AISafety#, #
MultiAgent#, and #
CausalReasoning# at
@JinesisLab! 🎉
Huge congratulations to all collaborators and co-authors. Excited to discuss these projects in Seoul! Feel free to reach out and talk to our 20+ members and collaborators in Korea
@ZhijingJin,
@_AndreiMuresanu,
@iarthsingh,
@ChanglingXavier,
@davidguzman1120,
@EmanuelTewolde,
@ettogran,
@FurkanDanismann,
@Jerick1380,
@PepijnCobben,
@rishit_dagli,
@_rfaulk,
@SimkoSamuel,
@TerryJCZhang,
@vantru0ng,
@zhxiao03,
@x_angelohuang,
@yahang_qi,
@ozzaney0101,
@_yongjinny.
Happy for collaboration on any of the above topics 🤝
EuroSafeAI, University of Toronto, ETH Zürich, Max Planck Institute for Intelligent Systems
Main conference spotlight
🌟 Safe Models Do Not Guarantee Safe Societies: The Case for Sociopolitical Risk
Main conference posters
📌 CauSciBench: Can LLMs Automate Causal Inference in Real-World Scientific Research?
📌 Training with Honeypots: Reshaping How LLMs Fail
📌 CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas
📌 Trustworthy AI Suffers from Invariance Conflicts and Causality is The Solution
📌 LLM for Physics Research Requires Domain-Specialized Training and Tooling
Workshop best papers
🏆When Agents Lie: Premeditation, Persistence, and Exploitation in Repeated Games
BEST PAPER
@NExT-Game Workshop
🏆Transferability for General Reasoning: An Automated Curriculum for Multi-Domain LLM RL
BEST PAPER
@RLxF Workshop
Workshop oral and spotlight
🎤 AF-ARENA: A Multi-Dimensional Evaluation Suite for Alignment Faking — AIWILD
🌟 Multi-Agent AI Systems Need Institutional Design, Not Just Model-Level Alignment — AI4GOOD
Workshop papers
📄 The Wedge Questions: Latent Cultural Boundaries in LLMs via Persona Projection Divergence — Pluralistic Alignment
📄 GT-HarmBench: Benchmarking AI Safety Risks Through the Lens of Game Theory — NExT-Game
📄 Stargazer: A Scalable Model-fitting Benchmark Environment for AI Agents under Astrophysical Constraints — AI4Physics
📄 Test of Time: Rethinking Temporal Signal of Benchmark Contamination — FoGen
📄 CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas — AI4GOOD
📄 Weight-Level Defenses Improve LLM Agent Adversarial Robustness — AI4GOOD
📄 Evaluating Cooperation in LLM Social Groups through Elected Leadership — AI4GOOD
📄 Causal AI Scientist: Towards End-to-End Causal Inference with Large Language Models — AI4Research
📄What Game-Theoretic Benchmarks Miss: Strategic Silence in Multi-Agent LLMs — FAGEN
📄Proving Your Way to Cooperation: Formalizing Proof-Based Open Source Game Theory in Lean — AI4Math
显示更多
Beautiful paper from Google DeepMind.
Explains the pathways from AGI to ASI, and why that jump could happen through several routes.
The authors frame the AGI-to-ASI transition around 4 technical pathways:
- continued scaling of compute, model size, data, and test-time inference;
- algorithmic paradigm shifts beyond today’s transformer-based foundation-model stack;
- recursive self-improvement, where AI accelerates AI R&D and improves future systems; and
- multi-agent collective intelligence, where large populations of specialized agents coordinate into a superhuman group agent.
Scaling may work for a while, but it could hit limits in data, compute, energy, or weaker returns from making systems larger.
Recursive improvement is the most uncertain path, because AI could speed up AI research, but that loop may also slow if hard research problems need real-world testing, scarce hardware, or new ideas.
Multi-agent collectives may be the most underappreciated path, because a society of competent digital workers could outperform a brilliant individual model through specialization, speed, and coordination.
The big point is that ASI may not arrive as 1 sudden event, but as a chain of faster changes as AI helps create better AI and stronger scientific tools.
----
– arxiv. org/abs/2606.12683
Title: "From AGI to ASI"
显示更多