注册并分享邀请链接,可获得视频播放与邀请奖励。

与「cluster」相关的搜索结果

cluster 贴吧
一个关键词就是一个贴吧,路径全站唯一。
创建贴吧
用户
未找到
包含 cluster 的内容
Agent 最缺的不是更大的上下文窗口,而是理解整个代码库的能力:当一个项目有数万文件、跨模块调用和海量文档时,为什么还要让 AI 一遍遍 Grep、Read、重新理解整个工程? 📦 项目档案 项目:Graphify-Labs/graphify GitHub Stars:⭐ 147299 技术栈:Python + Tree-sitter + NetworkX + Leiden 核心定位:将代码、文档、SQL Schema、PDF、图片及音视频转换成可查询、可追溯的知识图谱,让 AI Agent 从「搜索文件」升级为「理解工程关系」。 GitHub: 🛠️ 一、底层架构:不是传统 RAG,而是图结构知识引擎 Graphify 最值得研究的地方,是它没有走传统向量检索路线。 传统 RAG 通常需要经历: 文件切分 → Embedding → 向量入库 → 相似度检索 → 上下文拼接。 Graphify 直接构建 Graph。 底层采用 NetworkX 图数据结构,以 Node 和 Edge 表达工程实体及其关系。 整个处理链路可以概括为: detect() → extract() → build() → cluster() → analyze() → report() → export() 每个阶段职责独立,通过 Python Dict 和 NetworkX Graph 传递数据。 这意味着它不只是索引代码,而是在构建整个项目的结构化关系网络。 🛠️ 二、Tree-sitter AST:让代码解析摆脱 LLM 依赖 这是最有工程价值的设计。 Graphify 使用 Tree-sitter AST 解析约40种编程语言,提取: • Classes:类定义及结构。 • Functions:函数与方法。 • Imports:模块依赖关系。 • Call Graph:跨文件函数调用。 • SQL:表、视图、外键及 JOIN 关系。 其中33种语言使用 Tree-sitter Grammar,另外7种使用内置解析器。 关键在于:代码结构提取完全在本地完成,不需要调用 LLM,也不需要把代码上传到云端。 对于大型代码库,这种确定性解析比单纯依赖模型阅读文件更容易复现和追踪。 🛠️ 三、EXTRACTED / INFERRED:让每条知识关系都有证据 很多知识图谱最大的隐患是:模型推断出来的关系,很容易被误认为真实事实。 Graphify 给关系增加了置信度标签: • EXTRACTED:源码中明确存在的关系,例如 import、函数调用。 • INFERRED:通过上下文、命名和调用关系推断出来的连接。 • AMBIGUOUS:存在不确定性的关系,需要人工复核。 INFERRED 关系还会附带 0.0—1.0 的 confidence_score。 这套机制非常重要。 它实际上把知识图谱从一个简单的关联网络,变成了一个能够区分事实、推断与不确定性的工程知识系统。 🛠️ 四、Leiden + SHA256 Cache:解决规模与重复计算 Graphify 使用 Leiden 社区发现算法,根据节点之间的连接密度,将复杂工程拆分成不同功能子系统。 例如,一个大型后端项目,可以自动识别认证、数据库、路由、权限等不同社区。 同时,SHA256 内容哈希缓存会记录文件指纹。 文件没有变化,就跳过重复提取;只有新增或修改的文件才重新处理。 音视频还可以通过本地 faster-whisper 转录,再进入统一知识图谱。 这让增量更新不必每次重新扫描整个工程。 五、真正解决了什么工程问题? 想象一个场景: 你接手一个陌生的微服务项目,需要搞清楚: 用户认证最终连接了哪些数据库模块? 修改某个核心函数会影响哪些下游组件? 某个架构决策为什么会存在? 两个看似无关的模块究竟有什么隐藏依赖? 传统方式:Grep、Read、跳转、反复询问 Agent,消耗大量上下文。 Graphify:直接执行 query、path、explain。 它还能生成三个核心产物: • graph.json:完整知识图谱,可供后续查询。 • GRAPH_REPORT.md:核心节点、社区及关键关系分析。 • graph.html:可交互的可视化图谱。 甚至支持 Mermaid 调用链导出、Markdown Wiki 和 Obsidian 知识库。 最重要的设计思想是: 不要让 AI 每次都重新阅读整个世界,而是提前把世界组织成它能够理解和遍历的结构。 这才是 AI Coding 从上下文堆砌走向工程知识管理的重要一步。 对于大型 Monorepo、遗留系统维护、跨模块依赖分析,以及需要长期理解代码库的 Agent,这套架构尤其值得研究。 🔗 GitHub 开源地址:
显示更多
0
40
146
20
转发到社区
我一个朋友,35岁,在深圳某大厂干了9年,月薪4.8万,上个月被裁了。 这哥们是搞基础架构的,技术牛到什么程度? Linux内核参数、Nginx负载均衡、Redis Cluster、MySQL主从复制、Kafka消息队列、Docker容器化、Kubernetes集群调度,随便拎一个出来,他都能跟你聊到天亮。 尤其擅长处理线上事故。 有一年618大促,凌晨1点17分,生产环境突然出问题。 K8s集群里的Pod疯狂重启,CPU直接打满,Prometheus报警像放鞭炮,Grafana上十几条曲线同时飘红。 业务负责人在群里疯狂@人。 他从床上爬起来,打开MacBook,SSH连上跳板机,先查kubectl logs,再看OOMKilled,最后发现是某个服务的JVM堆内存设置不合理,叠加流量突增,触发了连锁故障。 他一边调整HPA自动扩容,一边通过ArgoCD回滚版本,半个小时把核心服务拉了回来。 第二天老板给他发了2000块红包。 说了一句:“公司离不开你这种技术骨干。” 这句话他记了三年。 后来公司开始降本增效。 他带头搞自动化运维,把Ansible、Terraform、GitOps全套打通,又接上AI Agent,实现了自动分析告警、生成故障报告、辅助执行回滚。 以前6个人轮班维护的系统,现在3个人就能管。 老板非常满意。 年底开会,还特意表扬了他的技术贡献。 结果第二年,部门调整,基础架构团队从12个人缩减到5个人。 裁员名单里,第一个就是他。 理由是: “你这个级别的工程师,成本太高了。” 他当场问了一句: “这些自动化系统谁来维护?” 领导回答: “你把文档交接清楚就行。” 那天晚上,他一个人坐在停车场,抽了半包烟。 9年时间,他把公司服务器的可用性从99.5%做到了99.99%。 每年替公司省下几百万运维成本。 最后公司发现,最容易优化掉的成本,竟然是他自己。 最讽刺的是,他离职那天,收到最后一条Prometheus告警。 不是服务器故障。 是公司把他的监控账号禁用了。
显示更多
0
15
201
13
转发到社区
I am actually disgusted by the timing of this drop. And this will get a bit more technical. Let’s do a real technical teardown of this "1,385-sigma Blackwell weight fingerprint" report that OpenAI and Anthropic are breathlessly promoting today, because banking on nobody reading past the headline is how DC narratives get manufactured. ​First, look at the actual CUDA maths: when PyTorch initialises model weights (torch.nn.init) with a fixed PRNG seed, curand/Philox parallelises random number generation across the GPU’s Streaming Multiprocessors (SMs). Because Hopper has 132 SMs and Blackwell has 148 or 152 SMs, the exact same seed lays out initial weights in a different spatial pattern depending on the GPU’s SM count. In huge MoE models, certain low-gradient null-spaces or unrouted slices preserve faint directional traces of those step-0 weights even after training. ​So yes, brute-forcing the seed and SM grid can show that a model’s step_0 weight initialisation script ran on a 148/152-SM Blackwell GPU. Now read what the summary explicitly admits in the fine print: 1. Initialisation is not full training: The report literally states that these signatures show how the weights were created, and "support (but do not prove) the inference that Blackwell also participated in model training". Initialising a model checkpoint takes seconds on a single rented dev node before loading the safetensors onto a standard Hopper cluster. The "2,000 to 3,000 Blackwell GPUs" and "$500 million" cluster numbers do not come from the weight fingerprint and Depue admits in his own thread that he simply "estimated" cluster sizes from release schedules and model details. ​2. Zero geolocation and zero proof of smuggling: The final sentence of the executive summary explicitly admits that the findings "do not establish the physical location of the chips, how they were acquired, or whether export control regulations were violated". Depue himself rented a cloud GB200 instance just to run his verification test. Commercial labs that are not on the Entity List renting bare-metal Blackwell nodes in offshore clouds (Singapore, Japan, or the Middle East) is completely legal under BIS rules and leaves the exact same SM fingerprint. Now ask yourself why a former OpenAI researcher dropped this on November 12, the exact day Jensen Huang was pushed out, with OpenAI and Anthropic immediately stepping in to "independently verify" it. US closed-source labs are watching their paid API moats get eaten alive by free Chinese open-weights models. Conflating a step-0 PRNG initialisation seed with a "$500M smuggled Blackwell cluster" hands DC hawks the exact pretext OpenAI and Anthropic want to regulate global cloud compute and kneecap open-source AI.
显示更多
0
18
394
60
转发到社区
I have a major result to share. I’ve found conclusive forensic evidence that the top 4 Chinese AI labs—DeepSeek, Moonshot, MiniMax and Ant Group—have built their newest models on NVIDIA’s most advanced Blackwell chips, which are barred from export to China. This sounds insane, but I discovered that almost every AI model carries a hidden signature of the GPU that trained it. When a model is first set up, the starting values of its weights are laid out in a pattern that depends on the exact GPU. Each combination of GPU and seed number produces a unique pattern—a sort of fingerprint of the hardware used to create the model. Traces of that pattern survive training into the published model. Again, this evidence isn’t based on any insider information or leaking. It’s based on a forensic analysis of the model weights released by the companies themselves. I searched more than six trillion combinations of chip layout and seed number and matched them to open-weights models. In doing so, I found conclusive evidence that six Chinese AI models—including DeepSeek-V4-Pro, Kimi K3, and MiniMax-M3—were initialized on NVIDIA Blackwell systems. Four of the models match Grace Blackwell, the GB200 and GB300 parts in NVIDIA’s flagship liquid-cooled rack-scale systems. I then verified these results on real hardware. Running unmodified PyTorch with the seeds I’d recovered, a Blackwell B300 reproduced DeepSeek-V4-Flash’s untouched starting weights bit for bit, and a rented GB200 reproduced Kimi K3’s to a correlation of 0.999995. A Hopper H100 reproduced none of DeepSeek-V4-Flash’s, and changing the seed by one broke the match. (DeepSeek’s seed is 953049583 by the way.) The method also was verified to match 24 known open-weights models to the hardware that developers said they used. It is exceedingly unlikely that these results are a coincidence. Across six trillion combinations, the best accidental match should reach only about 8 sigma (i.e., eight standard deviations above what random chance would produce). The real matches range from 49 to 1,385 sigma, and even the weakest single test hits 20. These were data-center-scale training runs. With some analysis of release schedules and model details, I estimate that the largest, Kimi K3 and DeepSeek-V4-Pro, used 2,000 to 3,000 Blackwell GPUs each. Clusters of this size cost on the order of $150 to $200 million each to buy, and across these labs alone would add up to more than half a billion dollars of export-controlled GPUs, not counting experimental compute or otherwise. It’s quite likely that we see multi-billion dollar expenditure on export-controlled GPUs. I am highly confident in this result, and it has been independently verified by senior researchers at OpenAI and Anthropic. You can read the full report at There is much more I’ve identified about these models through other forms of checkpoint forensics like this, and will have more to share soon.
显示更多
0
1.7K
38.5K
5.9K
转发到社区
Elon Musk, I decided to bring Jensen Huang onto the team because you simply do not pass up a once-in-a-generation opportunity to recruit the greatest compute architect on Earth. When it comes to building massive AI infrastructure, designing next-generation silicon, and scaling hardcore engineering at extreme velocity, nobody operates on Jensen’s level, and his vision for accelerated computing aligns 100% with what we are building across xAI, Tesla, and SpaceX. Bringing his unmatched expertise in-house to merge with our Dojo supercomputers, Grok clusters, and real-world robotics will compress years of innovation into months—and when legacy boards hesitate on true greatness, I am always going to bet big on the best talent in the world.
显示更多
0
5
42
15
转发到社区
Wild rumor coming out of China this morning on DeepSeek V5: DeepSeek is reportedly already pretraining V5 as a ~2 Trillion parameter ultra-sparse MoE model. And instead of training on NVIDIA GPUs, they are reportedly running the V5 pretraining run on Huawei's new Ascend 950 / 950DT chips with a team of Huawei kernel engineers physically working inside DeepSeek's offices to keep the cluster humming. If DeepSeek pulls off a 2-trillion-parameter frontier run natively on Ascend 950 silicon, that changes the entire AI hardware story.
显示更多
0
161
5.3K
443
转发到社区
Apple is working on a new app called Harbor Harbor turns your Mac into a private AI inference server. Run open-weight models locally on Apple silicon—your data never leaves your hardware, and nothing reaches the cloud. Connect multiple Mac computers over Thunderbolt 5 to pool unified memory, enabling large models and higher concurrency that a single computer can handle alone. Set up in minutes, not hours Harbor automatically detects your devices over Thunderbolt 5 to form a cluster. Plug in, start, and you’re running—no manual configuration, no command line, no infrastructure expertise required. Download and run models directly Browse, download, and load open-weight models from within the app. Harbor handles model management so you can focus on the work, not the setup. Cluster for scale Connect two or more Thunderbolt 5-capable Mac computers and Harbor pools their unified memory into a single inference resource. Run models that exceed any single computer’s capacity, or serve more concurrent requests across your cluster. Harbor is currently in a private preview under the Claris brand.
显示更多
0
211
4.9K
386
转发到社区
Grok Bot summary: IAC 2026 presentation by SpaceXAI President Michael Nicolls. 🎯 The main message - SpaceX was founded in 2002 to make life multi-planetary and "extend the light of consciousness to the stars." - He said the biggest risk as constellations grow is not debris. It's satellite operators not sharing data with each other. 🌍 How Starlink grew - Starlink began in 2019 with 60 V0.9 satellites. User service started in late 2020 as the "Better Than Nothing Beta." - V1.5 added space lasers, which let the satellites link into a mesh. That's when Starlink really took off, reaching oceans, Antarctica and airplanes. - V2 (2023) has 4x the capacity of V1. Falcon launches V2 satellites 2–3 times a week, and each launch adds about 3 terabits of capacity. - V3 launched on Starship about a week before the talk. Each V3 satellite has another 10x capacity, and each Starship launch carries 20–30x what a Falcon launch does. - Starlink now has over 11,000 satellites, about 60% of all active satellites in low Earth orbit. - It serves more than 13M customers in about 170 markets, plus ships and planes. - The laser mesh means Starlink doesn't depend on local ground infrastructure. During last year's fires and power outages in Spain, it kept tens of thousands of customers and emergency responders online. 🚀 The life of a Starlink satellite - **Before launch:** SpaceX checks that deploying the satellites won't bring them close to anything else, and shares where they'll be. - **Deploy:** satellites are released below 300 km, where almost no other operators fly. - **Orbit raising:** each climb path is checked against other satellites and crewed space stations, and SpaceX publishes the satellites' positions every hour on the way up. - **Lower orbits for safety:** the original plan was about 1,000 km. Now every satellite flies below 500 km, and V3 will fly at about 350–360 km. At these heights a dead satellite falls back to Earth within months instead of staying up for centuries. 🛡️ How they avoid collisions - Each satellite makes small station-keeping moves about once a day and a collision-avoidance move about every 10 days. - Across the fleet, that's about 1,000 avoidance moves a day. - Starlink's threshold for moving is nearly 100x more cautious than the industry standard, so the whole fleet's collision risk is about the same as a much smaller constellation's. - "Ducking" moves turn the satellite so it presents a smaller target during a close pass, cutting the collision risk about 10x more. - Automated software makes these decisions, which is why Starlink tries to stay in contact with every satellite at all times. 📡 Always connected - Starship's live launch video was streamed over Starlink. - The new V3 satellites connected to the network within 2 minutes of release, because Starlink terminals are built into the satellites. Their lasers link into the mesh within tens of minutes. - The goal is to make contact right away and never lose it. 🌬️ Space weather - During a 2024 solar storm, air density in orbit jumped 5x in a few hours, which throws off predictions of where satellites will be. - Starlink is "probably one of the best sensors" for this. It measures density in real time and automatically corrects its position forecasts. 🔭 Working with astronomers - **Optical:** SpaceX tried Vantablack paint and sun visors. What finally worked was a mirror-like film that reflects sunlight away from the ground, combined with careful steering. A V2 satellite now looks about as bright as a sheet of paper. This was done with groups like the Vera Rubin Observatory. - **Radio:** working with observatories like the US National Radio Astronomy Observatory (NRAO), Starlink steers its beams and frequencies around where the telescopes are pointing. As a result, the telescopes can now observe more often. ♻️ End of life - SpaceX uses statistics to predict when parts will fail and deorbits satellites early. Many of those satellites would have kept working. - Retired satellites are steered down within weeks, not left to drift for the 5 or 25 years regulations allow. - They're built to burn up completely, and reentry is aimed over the ocean. - Of about 10,000 satellites launched by early 2026, only a few dead ones remain in orbit. The goal is zero. - "Reliability and rate go together." ⚠️ The biggest danger: other operators - Tracked debris is like obstacles on a road: if you can measure it, you can avoid it. - What you can't avoid is a satellite that maneuvers without telling anyone. Starlink has had passes as close as tens of meters this way. - Starlink has maneuvered around satellites from about 650 operators in recent months, but shares position data with only about half of them. "That number is too low." - SpaceX shares data with China's space station and some Chinese operators. Many operators don't share at all, including some in the US, Europe and Japan. ⭐ Stargaze: Starlink's own space tracking - Over 30,000 star trackers on Starlink satellites spot passing objects as streaks against the stars. - Stargaze now tracks over 17,000 objects, including about 90% of the maneuvering satellites that cross Starlink's orbits. - In one example, an untracked satellite's predicted 9 km miss shrank to about 60 m after it maneuvered toward Starlink. Stargaze caught the move and the Starlink satellite dodged in time. - He said it's still no substitute for operators sharing their plans in advance. 🤝 The ask: share your data - SpaceX runs its own space safety data platform, and over 100 operators have signed up. - Operators can upload their satellite positions and check them against Starlink and against Stargaze tracking. - His message to every operator was to join the platform and share their positions. 🧠 StarMind: AI compute in space - StarMind is SpaceX's planned AI satellite constellation, starting launches and scaling next year. - The goal is to move AI compute off Earth. He expects StarMind to drive demand for Starship launches the way Starlink did for Falcon. - On the ground, SpaceX is building over 2 GW of compute in Memphis. He said AI demand will be nearly limitless, and Earth's resources make that hard to keep scaling there. - In space, the satellites run on solar power and shed heat through large radiators. - Each satellite is simpler than a Starlink: basically a computer with big solar panels and radiators. - Each one has about 250 kW, roughly one NVL72 rack of compute. - They'd fly in tight clusters of about 10 satellites linked by about 10 terabits of bandwidth, then connect to Starlink. - SpaceX has filed for up to **1 million satellites**, in low-inclination and sun-synchronous orbits. Building them could mean thousands of satellites a week. - New challenges include much higher reliability and redundancy, flying in close formation, and micrometeoroids. Dead satellites might be sent away from Earth instead of burning up in the atmosphere. 🌙 Beyond Earth - Starlink is developing very high-bandwidth lasers to connect the Moon, then Mars, building an "interplanetary mesh." - All of that depends on getting safety right in low Earth orbit first. 💡 Key takeaways - Starlink is the world's biggest constellation, and it's moving lower to be safer. - It makes about 1,000 collision-avoidance moves a day, with nearly 100x more caution than the industry standard. - The biggest risk is operators who don't share where their satellites are going. - StarMind could scale to 1 million AI satellites, with launches starting next year. - "Coordination is a key element for realizing all of our ambitions."
显示更多
0
34
224
50
转发到社区
LL Cool J warns Joe Rogan: programmers' political biases will ruin AI. On the Political Compass test, xAI's Grok is the only major AI that lands near the center. Anthropic, Google, Meta, and OpenAI all cluster far to the left.
显示更多
0
16
149
32
转发到社区
Anton Leicht explains how Washington could be blindsided by an AI jobs backlash because the people running the Super Intelligence Force haven’t prepared for the labor fallout: "There used to be this take of, clearly the jobs thing will happen first. That has sort of not happened, because the loss of control conversations blew up over the summer, and the job impacts just aren't there, at least not yet." "I still wouldn't underestimate how quickly the job loss issue can blow up. Even very limited, very locally clustered stories of people losing their jobs can very quickly blow up to national media attention." "I don't think the Trump administration has pre-developed messaging around why some job disruption might be acceptable. If this does happen, it would just blindside them, and then we'll see them scrambling." "You'll have people in the administration preparing for primaries, and suddenly there's this job loss narrative, and they feel like they're presiding over this AI build-out that's costing everyone their jobs." @anton_d_leicht
显示更多