Google DeepMind (@GoogleDeepMind) “Decoupled DiLoCo is also self-healing. We introduced artificial hardware failure” — TopicDigg
Google DeepMind
@GoogleDeepMind
The engine room of @Google. Building AI safely and responsibly to solve the world’s most complex problems. Join us:
加入 January 2016
279 正在关注 1.4M 粉丝
Decoupled DiLoCo is also self-healing.
We introduced artificial hardware failures during training runs. The system isolated the disruptions and continued operating, while reintegrating offline units when they came back online.
显示更多
