Demo
Armaan KapoorMarch 25, 20268 min read

Agents in knowledge work

The conservation of conscientiousness.

The constraint that shapes knowledge work is not intelligence. It is bandwidth. How much of the environment an agent can hold in working memory at the moment it has to decide.

An agent senses state, builds a representation, and takes an action. A thermostat is one. So is a trader. So is a doctor. So is an LLM. The difference between them is not capability. It is the size of the state they can hold while choosing.

Every complex system produces more state than any single agent inside it can hold. This is practically the definition of a complex system. The moment state exceeds bandwidth, agents compress. They build simplified representations and act on those instead of on reality. The representations disagree because they compressed different things. The system produces outcomes nobody chose or intended. This is emergence and probably why things always feel broken.

Hierarchy shakes loose as a solution. Stack agents. Narrow slices at high resolution on the bottom. Wider slices at lower resolution on top. Information compresses at every level. By the time it reaches the agent making the consequential decision, the original signal is unrecoverable. The decision is structurally unable to be better than the worst compression in the chain.

Markets try the opposite. Let agents with local information act locally and coordinate through price. This works until the local information is itself a lossy compression of something the agent couldn't hold. The trader acting on a financial model is acting on a compression of reality. The model is wrong in ways the trader can't see because seeing them requires holding more state than the model was built to compress. 2008 was a bandwidth failure disguised as a moral one.

Compression only goes one direction. Once the summary replaces the source, the source is gone in practice. Nobody routes back. The summary becomes the operating reality and the system builds on top of it. The next layer compresses the summary. The path back to ground truth requires retracing steps nobody documented because documenting the compression would require the bandwidth the compression was built to save. A doctor spends eleven minutes with the patient and forty with the charting system. The chart is a compression of the patient. The billing code is a compression of the chart. The insurance decision is a compression of the billing code. Four layers between a person and the decision about their own body.


Conscientiousness is conserved across these systems. The doctor is meticulous about the chart. The coder is careful with the billing logic. The reviewer is thorough with the case. The care is real at every layer. But it is pointed at the compression, not at the reality the compression replaced. You cannot be conscientious about something you never had the capacity to hold. Bandwidth determines where the care lands. Everyone is careful. Nobody is careful about the right thing. Not because they chose wrong. Because the bandwidth chose for them.

Each person compresses because they have to. Each person knows their compression is lossy. Each person assumes someone else is checking. Nobody is checking because checking requires holding the state the compression was built to avoid holding. The whole system runs on trust that the layers below are approximately right. When they're not, the failure is invisible until it's catastrophic. It was always happening. The loss just hadn't hit a load-bearing joint yet.

The constraint is not judgment. The constraint is what reaches the judgment. You can put the best person alive at the top of a twelve-layer compression stack and they will make worse decisions than a mediocre one acting on uncompressed reality.

Goodhart's law is the conservation of conscientiousness in its terminal form. The metric built to approximate the thing becomes the thing. The care points at the score. The score was always lossy. Now the loss is the objective.


You cannot fix this by building better compressions. A better summary is still a summary. The fix is making compression unnecessary at the point of decision. Which was impossible when the only agents available were humans with finite working memory and finite time. And which is becoming possible now for reasons that have nothing to do with intelligence and everything to do with bandwidth.

The agent that holds the full state doesn't need someone to pre-digest reality into a form it can process. It eats the raw thing. It needs judgment. It needs to know what good looks like. It does not need the compression. (Sometimes Claude Code larps sub-agents to cope.)

What changes is not that decisions get automated. It is that the compression becomes optional. The layers that existed to summarize stop being load-bearing. The conscientiousness that was spent on intermediate representations lands on the actual thing. The patient. The data. The business.

Everyone was always doing their best. Now their best touches reality.

Keep reading

View all