Kun Chen (@kunchenguid) “pro tip - when you use OpenAI's gpt models in Codex, it uses a server-side encry” — TopicDigg

pro tip - when you use OpenAI's gpt models in Codex, it uses a server-side encrypted compaction that seems to work better than anything else out there, which allows Codex to just keep hammering on long running tasks like there's infinite context window that's great, but if you run gpt in other harnesses like Pi, most of them don't inherit that by default, resulting in worse performance in long running tasks but - because of how extensible Pi is, i just found this cool extension from @alexisgallagher that enables the same server-side compaction in Pi - benchmark seems to support the argument that OpenAI server side compaction is indeed superior - so if you are using gpt models in Pi, install that extension to improve long running task performance. firstmate benefits a lot from this if you are using other harnesses, be aware of this difference and see if you can find a similar solution