Foundations: The Theory Under Modern AI

Cellular Automata

9 min read
On this page (17)

Definition: A cellular automaton is a grid of cells, each in one of a few states, that all update simultaneously according to a rule based only on their immediate neighbors. No cell can see the whole grid, and no central controller exists, yet the global behavior can be arbitrarily complex.

TL;DR: Cellular automata prove that complexity does not require complicated rules. Conway's Game of Life has four rules and is Turing complete. Von Neumann invented the format in the 1940s to answer a question about whether machines could reproduce. Build an AI app free →

Why Von Neumann Invented the Grid

In 1948 John von Neumann asked a question that sounded biological but was really about logic: can a machine build a copy of itself?

The obvious objection is a paradox about size. If a machine must contain a full description of what it builds, and it builds a copy of itself, then the description must contain a description of itself, which seems to require infinite regress.

Von Neumann's resolution was to use the description twice, in two different ways, and this is the same trick that DNA uses.

The description is interpreted once (as a blueprint to build from) and copied once (as raw data, uninterpreted). No infinite regress, because the copying step never needs to understand what it is copying.

Von Neumann needed a substrate simple enough to reason about rigorously, so at Stanislaw Ulam's suggestion he used a grid of cells. That was the first cellular automaton, and his self-replicating design used 29 states per cell.

The remarkable part is the timing. Von Neumann described this architecture around 1948 to 1949. Watson and Crick published the structure of DNA in 1953. He worked out the logical requirements for self-replication before anyone had seen the mechanism that implements it in life. See Self-Replicating Code for the full story.

Conway's Game of Life

In 1970, mathematician John Conway stripped the idea down to two states and four rules. Each cell is alive or dead, and every generation updates simultaneously.

   THE FOUR RULES              A GLIDER, over four generations
   --------------             (it moves one cell diagonally, forever)
   A live cell with:
     < 2 neighbors -> dies      . # .      . . .      . # .      . . .
     2 or 3        -> lives     . . #      # . #      . . #      # . .
     > 3           -> dies      # # #      . # #      # # .      . # #
                                . . .      . # .      . # .      . # #
   A dead cell with:
     exactly 3     -> born      gen 0      gen 1      gen 2      gen 3

That is the complete specification. There is no random element and no hidden state. Everything that follows is a consequence of those four lines.

What follows turns out to be a great deal. Life produces stable structures, oscillators, gliders that travel across the grid, glider guns that emit them indefinitely, and eventually complete logic gates. Because you can build AND, OR, and NOT gates from colliding gliders, and wire them together, Conway's Game of Life is Turing complete. Anything computable can, in principle, be computed by patterns of dots on that grid.

Pattern class Behavior Significance
Still life Never changes Stable memory
Oscillator Repeats with a period A clock
Glider Translates across the grid A signal in motion
Glider gun Emits gliders forever A signal source
Logic gates Gliders colliding Computation

Rule 110 and the Complexity Threshold

Stephen Wolfram studied one-dimensional automata, where each cell looks only at itself and its two neighbors. With two states there are exactly 256 such rules, and he classified their behavior into four broad classes.

Class Behavior Example outcome
1 Settles to a uniform state Everything dies
2 Settles to stable or repeating patterns Stripes
3 Chaotic, apparently random Static
4 Localized structures interacting Complex, structured, unpredictable

Class 4 is the interesting one, and Rule 110 is its famous member. It was proven Turing complete, which is a striking result: a one-dimensional line of cells with eight rules can compute anything a computer can.

The lesson generalizes. Universal computation is not a high threshold that requires elaborate design. It sits just past the boundary between order and chaos, and simple systems fall over that boundary easily. See Turing Completeness for why the bar is so low.

Computational Irreducibility

Cellular automata are also the clearest demonstration of a limit that matters for prediction generally. For many Class 4 automata, there is no shortcut: the only way to know the state at generation one million is to compute all one million generations.

The rules are simple, fully known, and deterministic, and the system is still unpredictable in the practical sense. Wolfram called this computational irreducibility, and it applies well beyond grids: to markets, to weather, and to sufficiently complex software systems.

What Cellular Automata Are Actually Used For

Beyond the theory, they earn their keep in a few places.

  • Physical simulation. Lattice gas and lattice Boltzmann methods model fluid flow with local update rules, which parallelize extremely well.
  • Procedural generation. Cave systems, terrain, and textures in games are commonly grown with automaton rules.
  • Traffic and crowd modelling. Local rules for each vehicle or person reproduce jams and flow patterns that top-down models miss.
  • Reaction-diffusion patterns. Animal coat markings and shell patterns are modelled with closely related local-rule systems.

The common thread is emergence: system-level behavior nobody encoded, arising from local rules everyone can read. That is the same phenomenon as emergent behavior in large models and in multi-agent systems, where capability appears at scale that was not present in any component.

Local Rules, Global Behavior, in Your Own Work

A team is a cellular automaton in the loose sense. Nobody sees the whole system, everyone follows local rules, and the organization's behavior emerges from that. Which means the leverage is in the local rules, not in the summary.

Describe the rules to Taskade Genesis: "when a request is tagged urgent and unassigned for two hours, escalate it to the on-call owner and post a notice." Taskade EVE builds it as living software over your projects, and an automation applies the rule to every item, every time. You set the local rule once and the global behavior follows.

Start building free →

Frequently Asked Questions About Cellular Automata

What is a cellular automaton?

A grid of cells, each in one of a few states, updating simultaneously according to a rule that depends only on neighboring cells. There is no central controller, yet complex global behavior can emerge from simple local rules.

What is Conway's Game of Life?

A two-state cellular automaton with four rules, published by John Conway in 1970. Live cells with two or three neighbors survive, dead cells with exactly three become alive, and everything else dies. It produces gliders, oscillators, and eventually full logic gates.

Is the Game of Life Turing complete?

Yes. Logic gates can be built from colliding gliders and wired together, so any computable function can in principle be computed on the grid. It is wildly impractical, which is exactly why it illustrates that capability and usefulness are different.

Why did von Neumann invent cellular automata?

He needed a mathematically tractable substrate to study whether a machine could build a copy of itself. Stanislaw Ulam suggested a grid, and von Neumann's self-replicating design used 29 states per cell.

What is Rule 110?

A one-dimensional cellular automaton with eight rules that was proven Turing complete. It demonstrates that universal computation sits just past the boundary between order and chaos, not at the top of a difficult ladder.

What is computational irreducibility?

The property that for some systems there is no shortcut to the answer: you must simulate every step. Many cellular automata have this property despite being simple and fully deterministic, which limits prediction in principle rather than in practice.

How did von Neumann predict DNA?

He worked out that self-replication requires a description used two ways: interpreted as a blueprint and copied as raw data. That is the same split biology uses: transcription and translation interpret a gene to build a protein, while replication copies the sequence without reading it. He described the requirement around 1948, several years before Watson and Crick published the double helix in 1953.

Are cellular automata used for anything practical?

Yes: fluid dynamics simulation, procedural generation in games, traffic and crowd modelling, and reaction-diffusion pattern models. Their local update rules parallelize very well.

Further Reading