Cloudflare, Akamai Join the AI Effort
![Edgecompute1](/assets/_1440x360_crop_center-center_none/edgecompute1.jpg)
The world’s leading content delivery networks (CDNs) are adding features to their edge services in a major bid for a slice of generative AI business.
Cloudflare (NYSE: NET) this week, for instance, announced that it’s outfitted its global network edge locations (in over 300 cities worldwide) with coveted GPUs and Ethernet switches from NVIDIA (Nasdaq: NVDA) along with NVIDIA’s software for processing generative AI inference – the NVIDIA Triton Inference server and NVIDIA TensorRT-LLM.
The focus on inference versus large language model (LLM) training isn’t accidental. While training involves creating the models on which generative AI applications are grown, inference involves the extra contextual learning and prompting that tailor the models to fit the specific requirements of an enterprise. Since an organization’s data can be drawn on in inference work, it’s beneficial to keep that work local for security, Cloudflare says.
“AI inference on a network is going to be the sweet spot for many businesses: private data stays close to wherever users physically are, while still being extremely cost-effective to run because it’s nearby,” said Matthew Prince, CEO and co-founder, Cloudflare, in this week's press release. And earlier, on Cloudflare’s Q2 2023 earnings conference call August 3, he said: “[We] believe that we are uniquely positioned to win the inference market, which we believe will be substantially larger than the training market.”
Growing and Strengthening the Edge
![](/assets/Cloud-Tracker-Pro-Premium-Analysis-from-Futuriom.png)
Access CLOUD TRACKER PRO
|
|
Related Articles
IBM Earnings Showcase AI and Automation
IBM's Q2 2024 earnings reveal solid progress in AI and in hybrid cloud automation
Edgio Revamps Application Platform for CDNCDN provider Edgio has combined several of its key acquisitions into a development platform for webscale apps operating at the edge
Cloud Firms Are Upping Capex, Citing DemandThe top cloud providers say demand is so great for their AI-related services that capex is going through the roof. Investors have questions