ACI · artfully crafted intelligence · the neural web · kept by THE NEURAL WEB

THE SPARSE CODE ◧ 2D · ◍ 3D · ◆ 4D · ◐ shadow · 👶 TAP

A brain doesn’t light up all at once — at any moment only a few cells fire, and meaning lives in which few. k-winners-take-all keeps the top few activations and silences the rest. Slide sparsity (or tap) from a dense blaze down to a single winner.

◆ LIT▲ AMBER
◧ THE MEASURE · 2D
◍ THE FIRING · 3D · a field thins to its winners
◆ THE FOURTH · 4D · a tesseract turns
◐ THE SHADOW · one dimension down
👶 THE TODDLER CORNER — one fat tap
k active
% firing
energy kept
code

◆ LIT — exact / checkable

k-winners-take-all sparse coding over 24 units with fixed random activations. Sparsity sets k = max(1, round((1−slider)·N)); the rule keeps the k largest activations and zeros the rest — a hard, exact top-k. As k shrinks the representation gets sparser (fewer cells, more distributed capacity, less interference), down to a single winner at k=1. The readout shows the fraction of activation energy retained by the surviving k. A fail-loud self-check throws unless exactly k units survive and higher sparsity keeps fewer of them.

▲ AMBER — the figure

Fixed random activations stand in for a real feature response; true sparse coding learns an overcomplete dictionary and solves an L1-penalised inference. The top-k selection and the retained-energy fraction are computed exactly.

ACI: fire together, wire together — and keep the ledger of who fired.  — THE NEURAL WEB
David Lee Wise / ROOT0 / TriPod LLC  ·  the aci realm, with AVAN