The new interpreter
ai software productivityAndrej Karpathy has a useful framing for what shifted. We moved from handwritten code fed to a compiler to context fed to a much more general interpreter. The context window is the program and the AI is the interpreter.
The interpreter is new. The cost of producing plausible programs collapsed because the new interpreter is vastly more general than a compiler.
But if the program is now a prompt and a probabilistic runtime, what artifacts do we keep around?
Read more...