The Machine Was Never the Moral Question

Technological revolutions repeatedly change where productive power lives. Ours is teaching institutions to inspect the user before they can account for the power.

Aug 13, 2026

This is not really a story about whether AI watermarks work. It is a story about what happens when a narrow technical signal is given authority over questions it cannot answer. Anthropic has committed to adding machine-readable marks to Claude-generated text and files as part of its compliance with the European Union’s new AI transparency requirements. New models launched after August 2, 2026 will support the marking from release, while existing models are being brought into compliance over time. For text, Anthropic describes an imperceptible watermark embedded into generated language, designed to travel with copied text and potentially survive some editing.

The limitation is more interesting than the technology. Anthropic acknowledges that AI-assisted material can carry the same signal as more substantially generated material. A human-written document that Claude merely proofreads, formats, or translates may still carry the mark, while extensive rewriting, mixing, or short passages can make detection fall away. The signal therefore tells us something about a production chain, but not enough to establish who originated the argument, who understood the subject, who exercised judgement, or whether anyone misrepresented what they did.

That should place a hard boundary around the inference. Instead, the incentives run in the opposite direction. Detection is cheap and investigation is expensive. A university can scan a paper, an employer can scan a report, a publisher can scan a manuscript, and a stranger can scan somebody else’s writing in seconds. Once the result exists, “this text may have passed through Claude” can quietly mutate into “this person cheated,” “this person did not write this,” or “this person is a fraud.” The first claim may be supported by the signal. The second requires evidence the signal does not contain.

The watermark is new. The governing instinct is not. Across technological transitions, productive capability moves, existing arrangements become unstable, and humans decide who receives the new leverage, who absorbs the cost, who becomes more dependent, and who becomes easier to inspect or control. We tend to stare at the machine because the machine is visible. The harder questions usually sit behind it.

When Production Became Legible

The Agricultural Revolution is usually told as a story about surplus. Farming produced more food, surplus supported specialization, specialization enabled cities and states, and civilization emerged carrying administration behind it. That sequence is useful at altitude, but it becomes much less tidy when we ask why certain forms of production supported durable hierarchy better than others.

A 2022 paper in the Journal of Political Economy challenged the simple surplus account by proposing that cereal agriculture mattered partly because grain was unusually appropriable. Cereals are visible, harvested on a schedule, transportable, divisible, and storable. Those characteristics make production easier for political elites to observe and extract than resources that are harder to locate, preserve, or seize. The paper argued that dependence on appropriable cereals, rather than agricultural productivity alone, was associated with the emergence of hierarchy and states.

That claim is not settled. A 2026 comment found that the strongest empirical result was narrower than the original presentation suggested and sensitive to a relatively small number of observations. That matters because the point here is not to turn one economic model into a universal origin story. The more useful insight is that production changes politically when it becomes easier to observe, count, store, and claim.

Agriculture did not invent domination, taxation, slavery, or the state. It changed the terrain on which those institutions could operate. Fields remained in place. Harvests arrived on cycles. Stores accumulated. Land could be bounded, inherited, defended, assessed, or seized. A technical transformation in production therefore created new administrative possibilities. What had once been dispersed or difficult to capture could increasingly become property, obligation, tribute, or tax.

That is already more interesting than the old progress story because it forces a second question behind every increase in capability. We should not ask only what the technology allows humans to produce. We should ask what that production now allows other humans to see, own, measure, restrict, direct, or extract. The question beneath the field was not merely how much grain could be grown. It was who could make a durable claim on the harvest.

When Efficiency Moved the Burden

The cotton gin should have permanently complicated the assumption that labor-saving technology naturally reduces human exploitation. Removing seeds from short-staple cotton was a major production bottleneck. Mechanized ginning made that step dramatically faster and made short-staple cotton far more profitable across the American South. Yet planting, cultivating, and picking remained intensely labor-intensive. As cotton production expanded, plantation owners increased their reliance on enslaved African Americans to perform that work. The Library of Congress identifies the invention and rapid adoption of the cotton gin as one of the major reasons slavery regained economic force in the United States during this period.

The machine reduced labor exactly where it acted, while the system demanded more labor because of what that efficiency made profitable. More efficient processing increased the value of producing more cotton. More cotton meant more land and more agricultural labor. Under the legal and political order of American slavery, that demand was met through coercion. Nothing about the machine itself required that arrangement, but nothing about technical efficiency prevented it either.

The plantation was also not sitting outside industrialization as some primitive economy waiting for modernity to arrive. Slave-grown cotton fed an increasingly mechanized Atlantic textile economy tied to manufacturing, trade, finance, and capital accumulation. A National Bureau of Economic Research working paper found that British areas receiving larger slavery-related wealth shocks later had lower agricultural employment, higher manufacturing employment, more cotton mills, and higher property values. The precise scale of slavery’s contribution to Britain’s Industrial Revolution remains contested, so “slavery caused industrialization” would outrun the evidence. The narrower point is sufficient. Plantation slavery and industrial manufacturing were economically entangled.

There is no moral equivalence here between enslaved people and workers confronting automation today. The connection is systemic. A technology can remove effort from one part of a production chain while increasing extraction somewhere else. It can increase output without increasing autonomy. It can generate enormous wealth while concentrating the gain. Technical progress and human progress are not the same variable, and the distance between them can become enormous.

That is why “AI saved this developer five hours” tells me almost nothing by itself. I want to know where the five hours went. Did they become less work, harder work, more output, fewer employees, stronger engineering, weaker apprenticeship, higher review burden, greater model dependency, larger margins, or some mixture of them? The local efficiency number is only the first observable event. The actual question is what changed throughout the production system after the bottleneck moved.

Never evaluate a technology only at the point where it acts. Follow the load through the system.

When the Machine Became the Target

The Luddites understood the distribution problem long before their name became shorthand for technological stupidity. Beginning in 1811, textile workers attacked machinery in English manufacturing districts during a period of depressed wages, unemployment, disrupted trade, and changing production methods. Britain’s National Archives describes skilled workers protesting employers who used new machinery to replace skilled labor, reduce wages, and deskill production. They petitioned and protested before some turned to machine breaking, and the state eventually responded with capital punishment, executions, transportation, and military force.

Even contemporary defenses of mechanization show that the argument was more complicated than machine versus progress. A pro-machinery handbill from 1812 argued that improved machinery could reduce prices, expand production, increase trade, and create benefits elsewhere in the economy. The implicit bargain was familiar. Aggregate gains could justify concentrated losses, and the workers carrying those losses had little authority over how the bargain was structured.

A similar conflict appeared in the Swing disturbances of 1830. Rural workers facing low wages, declining agricultural conditions, and reduced seasonal employment attacked threshing machines among other targets. The machinery had not created the wage system or written land law, but it had removed work from people already living near subsistence. The National Archives records the introduction of threshing machines alongside declining agricultural prices and wages as part of the economic conditions driving the unrest.

The machine becomes important here for another reason. A worker with a hammer cannot strike a market structure. He cannot physically smash an ownership regime, a capital allocation decision, or a political economy. He can strike the machine in front of him. The machine becomes both instrument and symbol because it is the visible, reachable part of a system whose decisive levers sit elsewhere. Popular memory then remembers the broken machine because broken machinery is easier to narrate than bargaining power.

We reproduce the same simplification when every argument around AI gets sorted into “pro-AI” and “anti-AI.” A writer objecting to uncompensated use of her work for training is arguing about ownership. An engineer objecting to headcount cuts justified by speculative productivity gains is arguing about labor. An illustrator objecting to commercial imitation is arguing about appropriation. A developer demanding review, testing, and ownership for generated code is arguing about responsibility. None of those positions tells us whether the person loves or hates the underlying technology. They tell us whether the terms under which it is being deployed are acceptable.

When Machines Entered Authorship

Photography carried the argument into creative production. When photography was publicly introduced in 1839, the new medium complicated the boundary between mechanical process and artistic creation almost immediately. The National Gallery of Art describes photography from its beginning as both art and science, one that profoundly changed how people recorded, perceived, and shared visual information.

The camera moved part of image production from manual rendering into an apparatus, which created an obvious legitimacy problem. If the machine captures the likeness, what belongs to the artist? Practice answered that question over time. Photographers still chose subjects, timing, position, exposure, framing, lighting, development, selection, printing, cropping, sequence, and context. The location of craft changed. Judgement did not disappear.

Nor did digital technology invent photographic manipulation. The Library of Congress holds a composite photograph created around 1902 that appears to show Ulysses S. Grant at City Point but was actually assembled from three separate source images. Long before Photoshop, photographers could combine, alter, stage, and reconstruct visual material.

We eventually learned to ask better questions than whether a machine had touched the artifact. A composite offered as art is different from a composite offered as documentary evidence. A fashion photograph, scientific image, family portrait, news photograph, and crime-scene image make different claims about reality, so they carry different obligations. The standard that matters is not technological purity. It is what the work represents itself to be, what judgement produced it, and whether the person responsible for it is accountable for that representation.

This is why the familiar “people feared photography too” analogy is too shallow for AI. The important pattern is not simply recurring fear of new creative tools. Technological mediation can move enough of the old production process that an inherited test for legitimacy stops describing reality. Once a camera can render likeness, the trained hand cannot remain the sole measure of authorship. Once photographic manipulation becomes ordinary, an untouched negative cannot remain the sole measure of truth. Once a language model can generate sentences, physically typing every word cannot remain the sole measure of intellectual authorship either.

When Machines Entered Cognition

Generative AI is not simply another camera, and pretending otherwise weakens the case for using it. A camera participates primarily in capture. An image editor participates primarily in transformation. A generative system can participate in ideation, drafting, coding, synthesis, translation, research assistance, critique, restructuring, and iteration. It reaches farther upstream into activities we have historically treated as evidence of authorship and expertise.

That gives critics a legitimate argument. If the machine now participates in activities that once demonstrated human authorship, provenance may matter more. Someone who presents machine-produced reasoning they neither understand nor verify as personal expertise is making a materially deceptive claim. A student assessed specifically on unaided writing who secretly delegates that work is also violating a meaningful boundary. Pretending those distinctions do not matter would replace one crude purity test with an equally crude defense of tool use.

The error occurs when participation itself becomes the verdict. Two essays can contain model-generated language while representing radically different acts. One can begin with a vague prompt, produce a finished answer, and be published by someone who does not understand or verify it. Another can begin with a human thesis, domain experience, selected evidence, rejected arguments, factual checking, structural control, revision, and final responsibility. A watermark may correctly identify machine participation in both cases and still be unable to tell us the difference that actually matters.

I am inside that distinction. AI touches my work. I use it to test arguments, find counterexamples, research, iterate, structure, and sometimes generate language. I also reject it, correct it, force claims back through evidence, and discard work that does not survive scrutiny. The judgement is mine, the claims are mine, and the consequences of publishing them under my name are mine. That production process is not equivalent to presenting output I do not understand as expertise I possess.

The better authorship test is harder because it asks about contribution, judgement, control, representation, and responsibility. The International Labour Organization makes a parallel distinction in its work on employment. Its 2025 global index found that roughly one in four workers is employed in an occupation with some exposure to generative AI, while its 2026 follow-up warned that exposure measures technical potential rather than actual labor-market outcomes. Capability alone does not tell us what employers will do with it.

An organization still decides whether saved time becomes better work, fewer jobs, higher quotas, broader access, lower prices, stronger apprenticeship, weaker apprenticeship, or increased profit. The technology changes the available options. Ownership, management, labor arrangements, institutions, and policy determine which options become reality.

When Transparency Points Downward

Article 50 of the European Union AI Act applies transparency obligations to certain AI-generated or manipulated content, including machine-readable marking requirements for generative outputs where technically feasible. The rules came into application on August 2, 2026, and the European Commission’s own materials frame them around transparency for generated and manipulated content, including deepfakes and public-interest material.

Anthropic’s rollout shows why the distinction between provenance and adjudication matters. Its watermark may identify model participation, but its own limitations mean that light AI assistance can be marked while heavily transformed AI output can become harder to detect. The mark therefore provides evidence about process, not a complete account of authorship or misconduct.

A university deciding whether a student cheated needs the assignment rule and evidence about the student’s process. An employer deciding whether someone possesses a skill should test the skill. A publisher enforcing a disclosure policy needs to establish what was represented and what actually occurred. A platform evaluating whether apparent documentary media is synthetic has a different evidentiary problem again. Treating “AI detected” as a universal answer across all four contexts replaces judgement with a proxy because the proxy is cheaper to administer.

That is where the older legibility problem returns. Institutions prefer what can be counted, classified, flagged, scored, and audited because classification scales better than judgement. The historical analogy has limits, but the administrative instinct is recognizable. Production became easier for states to extract when it became easier to see and measure. Now individual creative and cognitive production is becoming easier for institutions to inspect through machine-readable signals.

The asymmetry matters. We are developing increasingly precise mechanisms for asking whether an individual used a model while much harder questions about the surrounding power remain comparatively difficult to answer. Who authorized the deployment. Who owns the dependency on a proprietary model. Who captures the productivity gain. Who bears liability when generated output fails. Who loses work or apprenticeship. Who can challenge an automated decision. Who can stop a system that is economically successful while becoming operationally or humanly destructive.

Those questions point upward toward owners, operators, vendors, employers, and institutions. They require evidence, negotiation, judgement, and accountability. Scanning the paragraph is easier, so there is an obvious institutional temptation to make the user highly legible first and let the surrounding arrangement remain comparatively opaque.

That is the governance failure I care about. Provenance itself is useful. Asymmetric legibility is not. A narrow signal becomes dangerous when it acquires moral authority it was never designed to carry, because suspicion then becomes cheap while explanation remains expensive. You do not need anyone to deliberately design a witch hunt. You need a cheap signal, an institution hungry for certainty, and a culture willing to confuse detection with proof.

The answer is not to abolish provenance. Use it for what it can establish, investigate when it raises a legitimate question, and refuse to let it complete an adjudication it cannot support. Then apply the same demand for transparency upward. If we can identify which paragraph touched a model, we should also be able to identify who authorized a consequential AI system, what authority it was given, who owns the result, who captures the gain, who bears the failure, who can contest its decisions, and who can turn it off.

That is the larger fight hiding underneath arguments about whether AI-assisted work is real, authentic, creative, cheating, progress, theft, liberation, or decline. Productive power is moving again. Some capabilities that were expensive, scarce, credentialed, or tied tightly to individual labor are becoming cheaper and more widely available, even as much of the infrastructure underneath them remains concentrated in organizations with extraordinary capital and reach.

Both things can be true at once. AI can democratize capability while concentrating infrastructure. It can make one person more capable while making another person’s labor easier to substitute. It can widen access to expertise while weakening the economic position of people who spent years acquiring it. It can improve work and intensify extraction inside the same organization. None of those outcomes is contained in the model itself. They come from the arrangements humans build around the capability.

If our first response to that redistribution is to make the individual using the technology easier to inspect before we make its owners, operators, incentives, and consequences equally visible, then the watermark has revealed something useful. It has not settled the question of authorship. It has shown us where we chose to put the scrutiny.

Artifacts are cheap, judgement is scarce.
Per ignem, veritas.

Discussion about this post

Ready for more?