Most passing yards in 2010s:
Drew Brees - 46,770
Matt Ryan - 44,830
Philip Rivers - 44,320
Tom Brady - 43,727
Matthew Stafford - 38,758
Eli Manning - 38,379
Aaron Rodgers - 38,145
Ben Roethlisberger - 37,243
Joe Flacco - 33,483
Andy Dalton - 31,594
📊 Transit Weekly Report
👥 243,723 active traders
📈 $100,952,293 weekly swap volume
🔥 60.5% active traders market share
New narratives emerge every week.
Fast enough for opportunities.
Stable enough for every trade. @TransitFinance
I spent more test time compute and realized that my micrograd can be dramatically simplified even further. You just return local gradients for each op and get backward() to do the multiply (chaining) with global gradient from loss. So each op just expresses the bare fundamentals of what it needs to: the forward computation and the backward gradients for it.
Huge savings from 243 lines of code to just 200 (~18%).
Also, the code now fits even more beautifully to 3 columns and happens to break just right:
Column 1: Dataset, Tokenizer, Autograd
Column 2: GPT model
Column 3: Training, Inference
Ok now surely we are done.