Axios on MSN

Nvidia deal shows why inference is AI's next battleground

Chipmakers Nvidia and Groq entered into a non-exclusive tech licensing agreement last week aimed at speeding up and lowering ...
TipRanks on MSN

Why Nvidia’s (NVDA) $20 billion entry into AI inference is pivotal

Nvidia Corporation ($NVDA), the global leader in AI chips, announced a $20 billion investment in AI inference firm Groq on ...

Nvidia Licenses Groq AI Inference Technology in $20B Deal

Nvidia has licensed Groq’s AI inference-chip technology in a reported $20B deal, signaling a strategic shift as AI moves from ...
Business Wire

Vultr Launches Cloud Inference to Simplify Model Deployment and Automatically Scale AI Applications Globally

WEST PALM BEACH, Fla.--(BUSINESS WIRE)--Vultr, the world’s largest privately-held cloud computing platform, today announced the launch of Vultr Cloud Inference. This new serverless platform ...

AMD: The Physics Of Inference Favors The Underdog

AMD (AMD) is rated a 'Buy' based on its architectural strengths and plausible 3-5 year EPS growth framework. AMD’s higher ...
Forbes

The Inference Economy: How Sparse Computing And Model Optimization Are Reshaping Enterprise AI Deployment

The AI industry stands at an inflection point. While the previous era pursued larger models—GPT-3's 175 billion parameters to PaLM's 540 billion—focus has shifted toward efficiency and economic ...

Nvidia Acquires Groq Talent In A Strategic To Move Into AI Inference

Nvidia Acquires Groq Talent In A Strategic To Move Into AI Inference in order to expand its AI ecosystem and take over the ...
Semiconductor Engineering

A Novel Attack For Depleting DNN Model Inference With Runtime Code Fault Injections

A technical paper titled “Yes, One-Bit-Flip Matters! Universal DNN Model Inference Depletion with Runtime Code Fault Injection” was presented at the August 2024 USENIX Security Symposium by ...