与「inkling」相关的搜索结果

End-to-End 4-Bit Training：让大模型用更粗糙的数字格式完成全流程训练，大幅缩短显卡训练时间 训练大模型需要处理海量数据，直接把数字精度压到4位虽然能加快计算，但四舍五入累积的误差会严重拖垮模型的学习效果。 为了解决这个矛盾，Thinking Machines Lab在英伟达GB300显卡平台上开发了名为BBBK的专用底层加速程序。采取了分工策略，在模型向前推理计算时使用高速度的4位数字格式NVFP4，在向后更新参数时切回较精细的8位格式MXFP8，并在传输数据时顺手进行旋转压缩与随机舍入修正，省去了传统训练完成后还要单独做低精度校准的麻烦步骤。 这套方案应用在Inkling 2 Small模型的全流程训练中，显卡的运算管道和传输带宽同时跑满，没有出现互相等待的卡顿。原本需要好几周才能跑完的同体量模型，现在在GB300机柜上只用了68小时就完成了预训练。对比全程使用8位格式训练，新方案在预训练阶段节省了8%的时间，在强化学习阶段直接提速了20%，省下了大量算力开销，同时模型最终的回答准确率几乎没有受到影响。 链接：

Inkling 2 Small开源了 唯一能跟国模一战的美国开源模型，由Thinking Machines开源（前OpenAI首席技术官Mira创办）。 参数594B，激活参数17B，评分接近DeepSeek-V4.1-Flash-1017（763B），超过GLM 5.3 Flash。 模型：

Announcing OpenWorker! An open-source agent that doesn't just chat with you, but delivers finished work -- like hand you a polished document, send a slack message, or update a calendar entry. Ask it to prepare a customer brief, untangle your calendar, draft a report, or triage a Slack alert. It works across your files and everyday tools, produces the deliverable, and checks in before doing anything consequential. OpenWorker runs on your Mac, with Windows support coming soon. It does not lock you into any one model. Bring your own API key and run it with GPT 5.6 Sol, Claude Fable, Gemini 3.6, an open weight model (like Kimi, GLM, DeepSeek, Inkling), or Ollama to keep your data local. Your data does not leave your machine except through an LLM provider and integrations that you choose. @rohitcprasad and I are building OpenWorker because AI coworkers are an important way to get work done, and we want there to be an open, privacy-preserving, model-independent option. Check it out and let us know what you think! Try it out: (requires your own API key) Source code:

The FrontierCode leaderboard is now live: a dedicated page that tracks which models are writing code you’d actually merge. All scores — including Grok 4.5 and Inkling — are available, along with full methodology and sample tasks.

Thinking Machines - Inkling Thinking Machines Lab, the company founded by Mira Murati, has released Inkling, its first open-weights model under the Apache 2.0 license. Inkling is a mixture-of-experts transformer with 975 billion parameters in total, yet only 41 billion of them are active for any given token. Every layer contains 256 routed experts and 2 shared experts, and a router selects just the 6 most relevant experts per token. This means that only about 4 percent of the model performs computation during inference. The backbone is a 66-layer decoder-only transformer that combines local and global attention layers and supports a context window of one million tokens, which is roughly enough to fit eight novels or an entire codebase into a single prompt. The model was pretrained on 45 trillion tokens spanning text, images, audio, and video. Instead of relying on separate vision or audio encoders, it converts images into patches and audio into discrete tokens, then projects everything into one shared hidden space. All modalities are therefore fused from the very first layer. Inkling accepts text, images, and audio as input, while its output remains text only. On public benchmarks, it performs at the level of GPT 5.6 Sol and Claude Fable 5 in reasoning and agentic coding. The weights are available on Hugging Face, and the model can be fine-tuned through the Tinker API. #MiraMurati# #thinkingmachines# #inkling# #OpenSource#

Thinking Machines发布Inkling：Mira Murati团队的首个开源多模态大模型 975B总参数、激活41B的MoE架构，Apache 2.0协议，支持文本、图像、音频输入，输出文本。 跑分处于开源第一梯队中上游，HLE带工具46.0%、SWEBench Verified 77.6%、GPQA 87.2%，与Kimi K2.6、DeepSeek V4 Pro同档，距离闭源模型还有差距。 这是首个1T参数级别的开源多模态模型，且支持在自家Tinker平台做微调定制。 模型：

Today, we are introducing Inkling. Inkling reasons efficiently across text, image, and audio modalities. We are making the full weights available. Available today for fine-tuning on Tinker. Play with it in the Inkling Playground. 🧵

"President Trump single-handedly stopped Iran from getting a nuclear weapon," says @StephenM. "As a result of these negotiations, the United States is closer than ever before to inking an agreement that is going to finally create the roadmap for peace, security, and prosperity in the Middle East."