Updates on 2023/2/12

He knows that there are in the soul tints more bewildering, more numberless, and more nameless than the colours of an autumn forest […] Yet he seriously believes that these things can every one of them, in all their tones and semitones, in all their blends and unions, be accurately represented by an arbitrary system of grunts and squeals. He believes that an ordinary civilized stockbroker can really produce out of his own inside noises which denote all the mysteries of memory and all the agonies of desire.

— G.K. Chesterton

Pixel space is the ultimate IO surface between computers and humans — everything that isn't auditory or tactile ultimately gets flattened to raster images before it's consumed by our senses. It feels like a big part of my job in AI interface design these days is collapsing the layers of abstraction between pixel space and deep models' representations.

Most notable among these layers of abstraction in between pixels and raw information is writing, from written natural language to notations. The best notations flatten key operations to transformations in the pixel space.