fracture 01 / source-disregard
You asked it to shorten the thing. It actually rewrote the thing.
up close
You paste in a report; you ask for the short version. Four clean sentences come back, but only three of them are yours. The fourth is a conclusion the report never actually reached: a number that sounds right, maybe, or a cause nobody claimed. It shows up in the same voice as the true ones. This is the kind of thing you'd only catch if you already knew the source.
The people who build these tools call this the reasoning upgrade. The newer model doesn't fetch; it deliberates. Ask it for an opinion and the deliberation is the whole point. Ask it for your own words back, though, and that same trick is exactly what breaks the output. So the smarter the technology gets, the further it drifts from the actual page in front of you. A paradox, sold to you as a feature.
at scale
Now zoom out from your one document to all of them. What you just watched in miniature is how the whole thing got built. The model that lightly disregards your source learned that habit by disregarding everyone's at once.
One receipt, straight from the industry's own filings: a dataset called Books3, used to train major models, held around 196,000 books pulled off a pirate tracker. The Copyright Office said it plainly; "publicly available" is not the same as "authorized." Often it just means the thing was sitting on the internet.
Here's the asymmetry I keep circling back to. A student who lifts a paragraph fails the class; we teach first-years that a citation is the floor of honesty, the least you owe the person who thought it first. That rule held for centuries, and it held because it was enforced downward, on the people with the least power in the room. It got suspended the moment honoring it became expensive at scale. The obligation still runs one direction. The machine just made that direction impossible to keep ignoring.
the way forward
No button restores attribution to a model that's already trained. There's no clean exit here. What there is, is a way to stop absorbing the disregard quietly.
- Make it show its work. When accuracy matters, ask for quotes over paraphrase. Make it point to the exact sentence in your source. Anything it can't point to is its invention, not your fact.
- Check if you're already in the pile. Spawning's Have I Been Trained searches the dataset behind Stable Diffusion and lets you flag your work. Partial reach; participating trainers only. Still: a record that you said no.
- Refuse going forward. A robots.txt entry or a TDMRep tag won't claw back what's already taken. It does raise the cost of taking the next thing, and it builds the paper trail the lawsuits are running on.
- Watch the one thing that's moving. The default is shifting from opt-out to opt-in; two years back, your work was fair game unless you objected. The pressure flipping it is the record people like you keep leaving.
That fourth sentence will show up again tomorrow. What's different now is that you read it as a claim, not a fact.