与「modeltraining」相关的搜索结果

Hiwonder SO-ARM101 doesn't need a programmer – it needs a teacher. That's you. Move the leader arm, and the follower arm picks up every detail. Learn more 👉 #huggingface# #LeRobot# #modeltraining# #ImitationLearning# #ailearning# #algorithm# #opensource#

What a moment for @NPS_Monterey and the public sector. At Converge @ NPS, our CEO Jensen Huang joined federal leaders and ecosystem partners to commission the #NVIDIADGX# GB300 system, providing 1,500 students and 600 faculty with on-premises access to large-scale AI computing for research, model training, simulations, and real-world application development. The visit marked a shared commitment to advancing AI education, research, and mission-focused innovation.

Former $CRWV employee on why neoclouds are far more exposed to GPU generation cycles than hyperscalers ( $MSFT, $AMZN, $GOOGL ): - The expert describes GPU utilization tracking at hyperscale as a continuous and disciplined process built around two lenses. The first is infrastructure utilization, covering GPU occupancy, idle time, and memory utilization, noting that 95% booked usage can still mask inefficiency if jobs stall or batches have idle gaps. The second is outcome utilization, asking whether the compute is actually generating business value, measured by metrics such as tokens trained per dollar, time to reach target accuracy, and tokens per second per GPU. - The expert sees a meaningful difference between hyperscalers and neoclouds on GPU investment economics. Hyperscalers like $MSFT, $GOOGL, and $AMZN can tolerate a 3-5 year payback period given their ability to monetize the same infrastructure across multiple revenue streams. Neoclouds like $CRWV operate on a tighter 2-3 year window. - With higher financing costs and direct dependence on infrastructure cash yield, neoclouds are far more sensitive to utilization and GPU residual risk. The biggest risk is GPU generation cycles, where a slow payback means newer chips could erode pricing power before the asset has paid itself off. - The expert explains that for hyperscalers, roughly 60% of GPU capacity is allocated to external monetization, including GPU rentals, managed AI services, enterprise inference workloads, and startup model training. The remaining 40% is used internally, and of that internal portion, the majority is still indirectly monetized through products like M365 Copilot or GitHub. Around 40% is dedicated to pure R&D. - The GPU pricing mix has shifted meaningfully over the past few years. In 2023, around 70-80% of revenue was hourly as customers paid a premium just to get access to scarce GPUs. By 2025 that had moved to roughly 50% hourly and 30-50% committed, and the expert expects 2026 to tip further toward committed at around 65% for hyperscalers as AI matures and inference becomes more predictable. Neoclouds are moving in the same direction but more slowly. - By 2027-2030, the expert sees committed contracts settling at 55-65% as the norm, with hourly pricing remaining but losing its scarcity premium as more supply comes online.

🚀 Tencent Cloud Data Platform — The Unified Data Foundation for AI Built for the most demanding AI workloads—from AI Agents, multimodal intelligence, and data lakes to autonomous driving, and embodied intelligence—Tencent Cloud Data Platform provides a high-performance, cost-efficient, and unified data infrastructure that enables enterprises to accelerate AI innovation across the entire lifecycle, from data preparation and model training to intelligent applications.

Grok 4.5 is looking like a success with help from Cursor data but underneath the surface we expect future Grok/Cursor model training is likely to speed up in the coming months. We've spent several months getting up to speed on the SpaceXAI business, especially the tech underneath it. The C rewrite was under appreciated by the investor community so we dug in to quantify its impact. including building a physics first model that functions as a stopwatch for the SpaceXAI model factory. Bottomline: C-rewrite gets SpaceXAI faster model cycles, leveraging 33% more tokens/second/GPU against SOTA competition resulting in the potential to shipping new models every ~3.5 weeks. two core learnings from this modeling exercise: 1: the training cycle speed up is primarily coming from RL (not pretraining) where the increased tokens/second/GPU advantage can shave up 2+ weeks off full model training cycle. 2: the rewrite itself should compound the time savings as model sizes grow. at ~2T shaving off 2-3 weeks, ~8 weeks at 6T, and 15 weeks at 10T. Note: a 20T parameter model likely runs into a data bottleneck prior to a training speed bottleneck but the directional advantage stands. Also we assume tokens/second/gpu advantage will melt over time as competitors try to match it. when you do the math, in true SpaceX and Elon fashion, it looks like they are attempting to build a SOTA model factory that can pump out bigger models faster than anyone else. Full analysis here for the public:

🧱 Speaker Spotlight: Dong Meng Training the world's most capable AI takes more than clever algorithms — it takes infrastructure at a scale almost no one ever sees. Dong Meng is an engineer at @OpenAI working on the infrastructure that powers AI training and inference at massive scale. 🔹 AI infrastructure engineer at @OpenAI 🔹 Builds the systems behind OpenAI's frontier model training & deployment 🔹 Works at the scale where compute, reliability & performance meet The models get the spotlight — but the infrastructure is what makes them possible. Hear Dong on the Main Stage panel "Scaling AI Infrastructure at OpenAI" — alongside fellow OpenAI engineers Raymond Chen and Zihan (Gavin) Zheng — at AGI Summit SF 2026. 📅 July 18–19, 2026 📍 Palace of Fine Arts, San Francisco 🎟 Tickets: 🏷️ 15% off with code GenAI-26 #agisummit# #aiareall# #AIinfrastructure#

一篇不错的解读：《META出租H100与购买先进算力并不矛盾》 Meta 做 NeoCloud 与继续租 Crusoe 1.6GW，并不矛盾 昨天盘前，Meta 被报道正在考虑把多余 AI 算力对外商业化，甚至做成类似 NeoCloud 的业务。市场第一反应非常剧烈：Meta 盘前上涨接近 6%，但 AI算力和 neocloud 相关股票则受到负面 Narrative 影响, 市场担心的是：如果 Meta 也开始把 GPU 算力对外卖，是否会直接导致算力过剩？ 这个反应可以理解，但我们认为市场把问题想简单了。 首先，Meta 这件事本质上不是“AI 算力需求见顶”，也不是“Meta 不需要继续买算力”。相反，Meta 同时还在继续锁定非常大规模的新算力。根据 Bloomberg/Reuters 报道，Meta 最近与 Crusoe 签署了新的 AI computing capacity 协议，将从 Crusoe 位于 Texas Childress 和 Missouri Warrenton 的两个数据中心获得合计约 1.6GW 的容量。 同时，Meta还在向其他Neocloud购买算力。我们在去年3Q25 META Preview中就提到过META正在向NeoCloud寻求购买3GW算力。 所以表面上看，这里确实有一个矛盾：如果 Meta 自己已经有多余算力，为什么还要继续向 Crusoe 租 1.6GW？ 我们的理解是，这不是矛盾，而是算力代际切换。 过去两年，Meta 已经采购和部署了大量 H100/H200。这些 GPU 不是没价值，恰恰相反，它们对 inference、fine-tuning、企业模型服务、图像/视频生成、传统 ML workload 仍然非常有价值。但对于下一代 frontier model training，尤其是 3T+ 参数规模的 MoE、长上下文、多模态和 RL-heavy post-training，H100/H200 的训练经济性会明显下降。 关键不是 H100 不能训练，而是单位有效 token 成本变差。 当模型进入 3T+ 规模后，瓶颈不再只是单卡 FLOPS，而是 HBM 容量/带宽、GPU 间通信、scale-up 网络、checkpoint/restart、expert routing、sequence parallel、pipeline bubble、以及大规模 collective communication。H100 集群当然还能跑，但训练 wall-clock 更长，通信开销更高，集群利用率更难维持，最终表现为同样训练一个 frontier model，成本和时间都不如 GB200/GB300，未来更不如 Vera Rubin。 因此，Meta 现在面对的是一个很典型的资产配置问题： 最先进的 GB200/GB300/Rubin，要优先留给下一代模型训练；上一代 H100/H200，则应该尽量转成 inference 或外部商业化收入。 这也是为什么“做 NeoCloud”和“继续租 Crusoe 1.6GW”可以同时成立。 Meta 继续向 Crusoe 锁定 1.6GW，本质上是在为更长期、更先进、更大规模的 AI infrastructure 做准备。这种资源对于 Meta 来说，更多是未来 GB200/GB300/Rubin 时代的战略性产能，而不是简单补 H100 的缺口。 另一方面，Meta 既然已经买了大量 H100/H200，就不可能让这些资产在 frontier training 代际切换后闲置。Meta 内部当然有广告、推荐、内容排序等大量推理 workload，但这和 OpenAI/Anthropic 那种直接面向外部客户卖 token 的 LLM inference 业务并不完全一样。Meta 如果没有足够多可以直接 monetization 的外部 token demand，把 H100/H200 做成 cloud capacity 或 hosted model API 对外销售，是非常合理的资本回收方式。 这其实和 xAI / SpaceX 的思路有相似之处。xAI 今年公开宣布与 Anthropic 达成 compute partnership，向 Anthropic 提供 Colossus 1 算力；xAI 官方称 Colossus 1 包含超过 22 万张 NVIDIA GPU，包括 H100、H200 和 GB200，并可支持 training、fine-tuning、inference 和 HPC workload。(xAI) 这说明即使是 frontier AI 公司，也可能把一部分已有 GPU fleet 对外出租，同时把最新、最稀缺、训练效率最高的下一代集群保留给自己的 frontier model。 所以今天市场担心“Meta 进入 NeoCloud 会打垮所有 NeoCloud”，我们觉得有些过度。 更准确的判断应该是： AI 算力市场正在从单一的 GPU shortage，进入多代 GPU 分层定价和分层使用阶段。 第一层是最新训练算力：GB300、Rubin，以及后续更大 scale-up domain 的系统，主要服务 frontier model training。这部分供给仍然稀缺，客户仍然会向 Crusoe、CoreWeave、Nebius、Oracle、Microsoft 等各类供应商锁产能。 第二层是上一代高端算力：H100/H200/部分 GB200，更适合 inference、fine-tuning、enterprise AI、hosted model、agent workload 和中小模型训练。这部分不是没有需求，而是从“最稀缺的训练资源”变成“可以规模化商业化的推理资源”。 第三层是更通用的 GPU cloud 和 long-tail enterprise workload，对价格更敏感，但需求弹性也更大。 在这个框架下，Meta 的行为其实很合理：它不是停止建设 AI infrastructure，而是在把不同代际的 GPU 放到最适合的经济用途上。 因此，我们不认为这是 AI infrastructure 的大问题。真正重要的判断是：下一代 frontier model training 对 GB200/GB300/Rubin 的需求仍然非常强；同时，H100/H200 这类上一代 GPU 也不会被废弃，而会进入 inference monetization 和外部算力销售阶段。 这对整个 AI supply chain 的含义反而是： GPU fleet 开始变成多代际资产，而不是一次性训练工具。旧 GPU 不归零，新 GPU 继续稀缺。Meta 做 NeoCloud，不是需求崩了，而是算力资产终于开始金融化和商业化。

$AMD| The FOMO to buy @AMD Chips is NOW 🧵 Not Financial Advice! DYOR! Research Purpose Only! The Inference Queen is the biggest winner in Agentic AI where all other CPUs are struggling to compete with a 2yr old EPYC Turin and EPYC Venice is in mass production phase. AMD stresses deployability today on standard x86 platforms (no proprietary architectures required), full software compatibility, and open standards. This positions Venice + Helios as a practical, high-density alternative to competing solutions while underscoring that agentic AI shifts the balance toward CPU-rich racks alongside GPUs, and most importantly, lowering the cost of token to accelerate adoption and innovation. Context: @WSJ yesterday came out with an article that @OpenAI is condiering drasstically lowering the token prices to win more customers from Anthropic. The narrative "they" are trying to exacerbate the current AI selloff won't last long. This is a fundamental misunderstanding of what is going on, or what I already discussed for months and years. Followers and Subscribers already knew this for years, that this day would come, where token cost will bcome the central discussion among enterprises as there is no such thing as unlimited budget or Tokenmaxxing when they use $NVDA chips or In-house Hyperscalers chips. I will link various threads if you are interested in understanding the full picture from supply chain to recent TSMC Rapid 2nm expansion up to 12 Fabs total by 2027/2028. Hyperscalers and AI natives effectively have no choice but to buy more AMD system for Agentic AI as leadership in economical, power-aware, high-volume internal + agentic use. However, due to supply constraints where Supply is far behind Demand, this makes multi-vendor reality along with in-house chips drive faster industry progress, lower overall costs, and better sustainability. NVIDIA’s Vera Rubin cannot compete with a 2 years old EPYC Turin, but AMD under Dr. Lisa Su has engineered the lowest cost-per-million-tokens, highly competitive energy-efficient solutions, and superior CPU orchestration for agentic AI at scale with Helios. Dr. Su has championed this shift since at least 2023, foreseeing the rise of agentic workflows that demand far more orchestration, parallel agents, and balanced compute well before the industry fully embraced it. Her long-term vision of AI moving from simple prompts to always on, multi-agent systems has driven AMD’s investments in high-core EPYC CPUs and integrated rack-scale solutions, perfectly positioning the company for today’s realities. The OpenAI-AMD 1GW Helios deployment (starting H2 2026) represents a pivotal vertical integration move that directly supercharges the inference economics. This isn't incremental; it's a structural shift toward ownership of massive, optimized rack-scale capacity, enabling the lowest token costs and triggering the enterprise adoption flywheel. We need to be honest, $AMD is the only company that made a big bet on Inference since the day Chatgpt became sensational where $NVDA and others were betting big on Training. At the end of the day, Token bill from @AnthropicAI has to obey economics. Meaning the bills rise, companies have to get more out of it to justify the cost. It cannot be an unlimited inference budget, and it has to show up on efficiency, profitability and operating leverage. 1. Tokenomics After you understand this, you will understand why Citi cited @AnthropicAI is likely to sign a deal with $AMD along with Hyperscalers, AI Labs, Sovereign AI like Softbank 5GW in France and many other countries. However, OpenAI and $META are now wanting faster deployment, and they are AMD shareholders now, they have prioritized allocation. Anthropic and Hyperscalers just cannot compete when Helios Rack lower token cost to$0.0003–$0.0005 per million tokens at GW scale. Cost to build 1GW data center 1GW Helios Rack full build is estimated $30-$35B 1GW Rubin Rack full build is estimated $45-$55B Inference (Cost per Million Tokens) ~$NVDA B200 / HGX: ~$0.02–$0.08 on optimized workloads (FP4/MXFP4, speculative decoding). Significant improvement over Hopper but still premium-priced. GB200 NVL72 rack-scale: $0.05–$0.25+ ~$AMD Helios Racks: $0.0003-$0.0005 per M tokens, dramatically lower than NVIDIA equivalents in owned infra. MI355X node-level: Up to 40% more tokens per dollar vs. competing solutions ( B200), driven by higher memory capacity (up to 288GB+ HBM), strong bandwidth, and lower acquisition costs. Training ~$NVDA Rubin Rack is estimated $0.7-$1.2/M Tokens ~$AMD Helios Rack is estimated $0.65-$1.0/M Tokens Now, OpenAI, META and Hyperscalers can lower Inference cost even further with $AMD EPYC Venice "dense rack" or Agentic AI Rack. AMD published a detailed technical blog emphasizing that the future of agentic AI autonomous, multi-step AI systems requiring heavy orchestration, databases, caching, APIs, and control planes demands massive CPU-dense rack-scale infrastructure, not just GPUs. The catalyst prominently positions their upcoming 6th Gen EPYC "Venice" processors as the key enabler for next-generation dense racks, delivering leadership throughput under real-world power, cooling, and density constraints. ~EPYC Venice (Zen 6 architecture, up to 256 cores / 512 threads per socket) is projected to deliver exceptional rack-level performance. In AMD’s modeled 100 kW rack comparisons, Venice-powered systems are expected to achieve ~3.30x the throughput of NVIDIA’s Vera (88-core Olympus) baseline across a broad mix of agentic-supporting workloads. ~This builds on current-generation 5th Gen EPYC "Turin" (up to 192 cores), which already delivers ~2.37x rack throughput vs. Vera and ~1.6x vs. Intel’s Xeon 6980P (128 cores). ~ Liquid-cooled Turin deployments already support >27,000 CPU cores per rack today. Venice is architected to push this beyond 36,000 cores in the same rack class, dramatically increasing concurrent agent capacity and overall infrastructure efficiency. 2. Ownership vs renting compute from Hyperscalers matter to OpenAI and only owning $AMD chips can meaningfully lower token cost for enterprises. ~Eliminates cloud overhead: No provider margins, utilization buffers, or egress fees. Direct control over power contracts, cooling, scheduling, and orchestration at dedicated facilities. ~Helios optimizations at GW scale: Rack-level density (1.4+ exaFLOPS FP8 per rack), high HBM4 bandwidth, EPYC orchestration for agentic workloads, and superior TCO/TDP. AMD's long-standing focus on tokens per dollar/watt shines here 20-40%+ efficiency edges in inference-heavy scenarios. ~At 1GW+ optimized deployment, inference hits $0.0003–$0.0005 per million tokens (community/analyst models tied to Helios metrics). This is dramatically lower than typical rented/cloud equivalents, especially for high-volume output tokens in agentic flows. High token bills today, enterprises running heavy agentic/coding/analysis workloads can face $50-100M+/month at current API rates (flagship models $5-30+/M output, scaled to massive volumes). Post-Helios compression, same volume will drop to $10-15M/month (or better) via lower underlying costs passed through as pricing flexibility, volume tiers, caching, or batch discounts. ROI thresholds collapse. More companies greenlight pilots → production → massive scaling. Agentic AI (autonomous workflows) multiplies token demand exponentially, but affordability removes the friction. OpenAI gains flexibility, Unlike more cloud-dependent rivals (Anthropic), they can lower effective pricing, offer aggressive enterprise bundles, or absorb volume without margin destruction directly tackling "high token bill" complaints while maintaining profitability as usage explodes. 3. Agentic AI Models shifted CPU:GPU Ratio to 1:1 toward 3-5:1 with Explosively Token-Hungry Workloads Agentic AI (autonomous, multi-step agents with planning, tool use, iteration, and self-correction) is fundamentally more compute and token intensive than conversational or single-turn generative AI. Agentic AI. autonomous, multi-step workflows with orchestration, tool use, parallel agents, data movement, and enterprise integration has dramatically increased the importance of strong host CPUs alongside GPUs. This shifts the CPU-to-GPU ratio higher and makes balanced systems critical toward 1:1 to 5:1 as enterprises testing more than 5-10 agents. AMD EPYC Venice excels ~Leadership core density (up to 256 Zen 6 cores per socket) for running many agents in parallel, orchestration layers, and high-throughput control-plane tasks. ~Superior performance-per-core and power efficiency ( up to 2.1x higher perf/core and 2.26x better SPECpower vs. NVIDIA Grace in benchmarks). ~Tight integration in Helios: One Venice CPU + multiple MI450 GPUs per node, enabling efficient data feeding to GPUs ("zero-copy"), parallel execution, and full rack utilization for complex agentic loops. Hyperscalers (Meta, Microsoft, Amazon, Google, Softbank) and AI natives (OpenAI, Anthropic...) are adopting high-core EPYC at scale specifically for these agentic demands, as CPUs now handle a larger share of non-model work (orchestration, policy enforcement, tool calls). This complements AMD’s lower-cost GPUs for overall TCO wins. ~Agents often generate 10–100x+ more tokens per task due to iterative reasoning chains, multiple tool calls, verification loops, and long-context orchestration. ~Goldman Sachs forecasts token consumption multiplying 24x by 2030 (to 120 quadrillion tokens/month) largely driven by agentic adoption in consumer and enterprise. ~Enterprise data shows agent-pattern workloads growing at 680% annualized rates, projected to surpass conversational AI in token volume by Q3 2026. ~Daily enterprise agent token consumption is already in the billions, with complex workflows (coding, workflows, analysis) amplifying this dramatically. 4. Competitive Edge: Winning Customers from Anthropic Anthropic’s Claude models (especially Opus/Sonnet) excel in complex reasoning and agentic coding, commanding premium positioning. However, their higher underlying costs (heavier reliance on third-party cloud with margins) limit pricing flexibility compared to OpenAI’s owned Helios capacity. Anthropic is on track to generate $10.9 billion in Q2 revenue. The company expects to achieve its first-ever quarterly adjusted operating profit of $559 million. However, sustaining full-year profitability remains challenging due to immense computing and model training costs The truth is, Anthropic has no choice but to buy as much $AMD chips as possible if they want to compete with OpenAI or get investors attention. This 5% adjusted operating profit to revenue ratio is just pathetic. Current pricing dynamics (2026): OpenAI already undercuts on many tiers ( flagship output tokens significantly cheaper than equivalent Claude Opus). Nano/mini models offer 5–10x advantages for volume work. Anthropic holds edges in long-context flat pricing and certain reasoning quality. OpenAI after Helios Rack Ownership, At $0.0003–$0.0005/M effective costs, OpenAI gains massive headroom to: ~Aggressively discount high-volume agentic tiers or bundles. ~Offer “unlimited” enterprise plans or usage-based models that Anthropic struggles to match without margin erosion. ~Target cost-sensitive, high-throughput agent deployments (dev tools, automation platforms) where token bills explode. Enterprises facing $ millions in monthly agentic bills will migrate to the provider delivering better economics at scale. OpenAI’s combination of strong models (o-series reasoning) + lowest TCO positions it to erode Anthropic’s enterprise share, especially as agentic becomes the dominant token consumer. Cheaper tokens expand the total addressable market dramatically. This feeds the data/model improvement loop, justifying further capex. AMD benefits from proven scale pulling in more customers (Meta, Oracle, Microsfot, Amazon, Softbank, TensorWave, LumaAI ... already aligned on Helios). Conclusion: Dr. Lisa Su has been laser focused on inference economics since at least 2022–2023, repeatedly emphasizing that the real battleground for AI scalability would be TCO, power efficiency (TDP), and ultimately tokens per dollar and per watt not just raw training FLOPS. While many viewed inference as a secondary, commoditized workload, Dr. Su architected AMD’s roadmap around rack-scale systems optimized for high-volume, sustained inference that would dominate as models matured and usage exploded. Helios represents the culmination of that multi-year bet: a fully integrated, open platform designed precisely for the economics of massive token throughput. This deep, strategic partnership with OpenAI starting with the 1GW Helios deployment in H2 2026 and scaling to 6GW, is the embodiment of that shared vision. Both companies foresaw a future where agentic AI models evolve to become extraordinarily token-hungry: autonomous agents executing complex, iterative workflows with planning, tool use, verification loops, and long-context reasoning. These workloads can consume 100x+ more tokens per task than traditional chat or single-turn generation, driving exponential demand as capabilities improve and enterprises deploy them at scale. By owning and optimizing this massive Helios capacity at GW scale, OpenAI achieves inference costs as low as $0.0003–$0.0005 per million tokens. This structural cost advantage allows OpenAI to absorb the coming token explosion profitably, dramatically lower effective pricing for enterprises, and win high-volume agentic workloads from higher-cost competitors like Anthropic. What was once a prohibitive monthly token bill becomes an affordable accelerator for productivity and innovation. The OpenAI-AMD alliance validates Dr. Su’s prescient strategy and turns the Agentic flywheel into reality: Collapsing inference costs → explosive token consumption → richer data and better models → accelerate greater demand. This partnership doesn’t just address today’s economics, it positions both leaders at the center of the infrastructure buildout that will power AI’s next decade. By delivering the lowest inference economics at scale, OpenAI not only solves enterprise bill pain but gains a decisive weapon to win share from higher-cost rivals like Anthropic. And that is why @OpenAI and $META will deploy EPYC Dense Rack Not Financial Advice! DYOR! Research Purpose Only!

At Huawei Cloud INSPIRE 2026, Huawei Cloud introduced a new paradigm of Agentic Infra, alongside a series of Agentic AI products: Agentic Infra unified infrastructure for general & AI workloads, new-generation model training & inference platform, and an enterprise agent platform.

At Huawei Cloud INSPIRE 2026, Huawei Cloud introduced a new paradigm of Agentic Infra, alongside a series of Agentic AI products: Agentic Infra unified infrastructure for general & AI workloads, new-generation model training & inference platform, and an enterprise agent platform.