Now live: $OKB
OKB is the native gas token of @XLayerOfficial, a high-performance Layer 2 blockchain built on the OP Stack, powering network transactions and connecting users, developers, and applications across the ecosystem
Trade now →
take a moment to appreciate how the US never really had famines while Europe, China, Russia, and India all suffered catastrophic ones well into the 20th century
in china, famine was the primary sign of losing mandate of heaven
US geography is so OP it's not even funny
I spent more test time compute and realized that my micrograd can be dramatically simplified even further. You just return local gradients for each op and get backward() to do the multiply (chaining) with global gradient from loss. So each op just expresses the bare fundamentals of what it needs to: the forward computation and the backward gradients for it.
Huge savings from 243 lines of code to just 200 (~18%).
Also, the code now fits even more beautifully to 3 columns and happens to break just right:
Column 1: Dataset, Tokenizer, Autograd
Column 2: GPT model
Column 3: Training, Inference
Ok now surely we are done.