Bio Mirror / Cellular
The Cellular Machinery
The nervous system is built from cells whose physical geometry — dendritic branching, axon diameter, myelin thickness, the molecular architecture of a synaptic cleft — is the computation, not a container for it. This is the level at which the artificial neuron abstraction is thinnest, and therefore the level where the differences from artificial networks are most informative.
A neuron computes with its shape. Change the branching and you change the function.
The Neuron
An excitable cell that integrates thousands of inputs across a branching structure and emits a timed spike train.
Biology
The neuron integrates its inputs across space and time and emits an action potential when the membrane potential at the axon hillock crosses threshold. Because dendritic branches compute locally, a single neuron is better modeled …
In AI
The artificial neuron — a weighted sum through a nonlinearity — abstracts this to its simplest possible form. The correspondence that holds: many weighted inputs, one integrated output, a threshold-like response, and learning stored in …
In Robotics
In robotics the closest match is not a controller but a sensor node in a distributed network: a unit that integrates local signals, applies a threshold, and transmits only when something has changed. Event-driven cameras, …
The Synapse
A chemical gap where a weight is stored, modified, and read — the biological parameter.
Biology
The synapse sets how strongly one neuron influences another, and that strength is the storage medium of learning. Strength depends on release probability, vesicle count, and receptor density — several partly independent variables rather than …
In AI
A synapse is a weight. The parallel is genuinely tight — this is the one place where the biological metaphor earns its keep. Hebbian learning ("fire together, wire together") maps onto correlation-based update rules, and …
In Robotics
The closest control-theoretic analogue is an adaptive gain: a coupling coefficient tuned online by experience rather than fixed at design time. Adaptive control systems that adjust their gains from tracking error are doing, in a …
Sparse Coding and the Energy Budget
Spikes cost energy, so the cortex represents the world with as few active cells as it can.
Biology
Sparse codes are metabolically cheap, since spikes dominate the energy budget. They are also computationally useful: sparse representations are more separable, easier to read out with a simple downstream classifier, and less prone to interference …
In AI
This is the direct ancestor of sparse autoencoders in mechanistic interpretability. The setup is nearly identical: an overcomplete dictionary, an L1 sparsity penalty, and a reconstruction objective. Where the neuroscience used it to explain measured …
In Robotics
Event-driven sensing and sparse state estimation follow the same logic: transmit and process only what changed. On a power-constrained mobile robot this is not an elegance argument but a battery-life one, which is precisely the …