Linus's stream

I feel like the concept of a "device" is constraining. There are no devices in the physical world. Only materials and objects. Devices intermediate us and our things to our detriment.

Three phases of creative production

(Excerpt from some old research notes.)

  1. Gathering raw materials
    • Through reading and consuming media, listening to others, thinking aloud in conversations, or just pure contemplation, the user gathers a bundle of ideas and related experiences that start to point to some insight or further idea.
    • A lot of creative value comes from this very unstructured stage of creation where ideas are gathered without any goal directed work. This I call "simmering".
  2. Active thinking
    • In the active thinking phase, the user looks at the gathered raw materials and tries to form structure out of them to produce something that's coherent and clear and perhaps even actionable.
    • This implies and requires a "sense-making" process, of going from unstructured information to emerging a structure out of it.
    • In the process of active thinking, even more raw materials may be gathered, perhaps in a goal-directed way. Information may also be discarded or deemed no longer relevant.
  3. Production
    • For the user to create some creative work/output from ideas or insights gathered during active thinking, it must be crystallized into a form that can facilitate communication. This I call "drafting" or "production" and is a writing/communication process more than a thinking process. It is about serializing thought into media.
    • Production may often also serve the role of communicating with oneself, i.e. when taking notes for my future self, to remember my past thoughts.

humans are but agents of writing.

writing crystallizes too early and corrupts too often but we trade off agency and flexibility for the clarity of thought we get when we channel it onto the page.

Remember to imagine and craft the worlds you cannot live without, just as you dismantle the ones you cannot live within.

— Ruha Benjamin

Perhaps every science must start with metaphor and end with algebra; and perhaps without the metaphor there would be no algebra.

Max Black, via Ivan

Even when we extrapolate arbitrarily far into the future of very large, very capable ML models, as long as they are built on the current paradigm (Internet-scale self-supervision followed by fine-tuning for desired behavior), I think being Extremely Fucking Good at anything will still remain valuable, regardless of field.

At the upper echelon of any craft you're a tastemaker more than a skilled hand, and taste is like entropy — there is only so much you can distill from a limited dataset into a model before it starts losing fidelity.

Human preference data will always be a scarce resource.

I want a version control/edit history browsing interface that lets you view your file as a 2D image extruded out into 3D space into the time dimension. Instead of seeing spans of text crossed out and added, you just see them appear lower down the "time stack" and disappear higher up. And then I can imagine scrubbing through slices of this time stack with a dial or a scroll wheel like scrubbing through slices of a CT scan.

I like this because it gives physical materiality to answers to abstract questions like "how often does this file change"? or "Which of these changes were more persistent"? or "Are there more additive or subtractive edits to this project in the last month?"

Thinking in high perplexity; speaking in low perplexity.

People who seem like they had good ideas earlier than everyone else didn't usually have uniquely good ideas. They had ideas that seemed merely credible at the time, but had extraordinary conviction in them.

— AV.

Wikipedia vs OpenAI

WWW vs Google

Roads vs vehicles