stevibe (@stevibe) “This looks like a toy. It's actually the meanest little vision eval I've built.” — TopicDigg

This looks like a toy. It's actually the meanest little vision eval I've built. The task: look at an emoji image, then repaint it on a 16×16 grid, one pixel at a time. Just the model, a tiny canvas, and up to 2000 brushstrokes. What I didn't expect was the personalities. > some models REGRET a stroke and go back to repaint it > some get stuck looping the same little patch over and over, like they're trying to animate it > some are calm little surgeons and just nail it first try And the task is genuinely mean: it has to see the image, crush it down to 256 cells, then decide what's actually load-bearing: > the tears on 😂 but still keep the smile > the horn on 🦄 > the antenna on 🤖 and keep the soul of it with almost no resolution to spare. 5 models. 7 emojis. Best of 5 runs each. Side by side. Who's your winner?