Clockwork Helps GPUs Keep Busy
Startup Clockwork.io recently launched a flurry of news highlighting its position in the market for AI cluster efficiency, a growing concern for enterprises, hyperscalers, and neoclouds. And in the process, the vendor laid claim to some capabilities that make it stand out.
Topping the news was Clockwork’s launch of FleetIQ, a software-based solution designed to keep GPU clusters working at top efficiency. Based on complex telemetry developed at Stanford, FleetIQ acts as “a Waze for GPU clusters,” according to Dan Zheng, Clockwork’s VP of Products and Solutions.
Zheng notes that link failures and other disruptions in today’s AI networks are significant, leading to GPUs from NVIDIA or AMD only being utilized from 30% to 55% of their theoretical performance capabilities. The result is enormous waste: Clockwork estimates that a typical 100,000-GPU hypescaler/neocloud training cluster priced between $5 billion to $7 billion could lose over $2.25 billion in unused capacity given these failure rates.
And that’s the problem Clockwork says it solves with a combination of highly granular observability combined with failover capabilities and adaptive routing to minimize delays and maximize throughput in GPU clusters.
Synchronized Timing and Traffic Control
To access the rest of this article, you need a Futuriom CLOUD TRACKER PRO subscription — see below.
Access CLOUD TRACKER PRO
|
CLOUD TRACKER PRO Subscribers — Sign In |
