Ink & Switch and Anthropic produce far and away the best-written and best-produced research reports in computer science-related fields (as far as I can tell), and everyone else should strive to reach for the same level of presentation, accessibility, clarity, and depth.
Underrated fact about training in the very large regime: you don't have to worry about overfitting/early stopping because single-epoch training is the default, and it turns out it's No Big Deal at all if you do single-digit number of epochs on these huge AF overparameterized models!
Academic benchmark datasets that are in the order of tens of thousands of samples are annoying in this way.
Interface design for generative AI systems: It's like we finally performed alchemy, but haven't invented chemistry yet.
How OpenAI bets, per Reid Hoffman interviews Sam Altman:
Invest in and capitalize on the next thing when it's right in front of you (and you can be confident in scaling laws), and with the rest of your efforts, execute novelty search to find the next seed of the big thing.
The best thing about this website is that nobody can dunk on these posts like on the bird app.
"Brevity is the soul of wit" but most people on Twitter don't have wit so you're just left with soul crushing waterfalls of the concise and contentless hyperoptimized by the unrelenting market forces of attention.
Attending to UC Berkeley seems to take most kids remotely interested in computers and somehow radicalizes them makes them all want to be founders and #build and "invest in their best friends" and this cannot possibly be a good thing.
There are most definitely kids who will make great founders, perhaps even fair to say there are some kids who are equipped to found a company at 22 years old at Berkeley. But to have this be the overwhelming and central cultural dogma, and have this vortex suck all creativity out of everyone and flatten all their personalities to that of a mediocre seed stage SaaS founder, feels almost criminal.
Everyone's talking about copying Twitter as a product but someone should just do Twitter DMs as a product. There's so much utility in having anyone (pseudonymously) be able to message you w/o exposing a fairly security sensitive unique identifier string.