Read news on AI inference with our app.
Read more in the app
AI inference startup Fal doubles its valuation to $16B as demand surges
Darkbloom, which allowed Mac users to rent out their GPUs for AI inference, warns of low payouts
AMD and Intel will work together to create a single PyTorch code path for AI inference on CPUs
AI inference is running into a memory bottleneck. Huawei wants to tackle it with OceanStor M900
Cohere's Model Vault now encrypts AI inference so even Cohere cannot see enterprise customers' data
Startups want to rent your idle gaming PC for AI tasks — Startups pitch an 'Airbnb for AI inference,' but profitability remains unproven
Hot Chips 2026: Samsung makes LPDDR5X smart with logic unit in memory — LPDDR5X-PIM is 3.01x faster than LPDDR5X in AI inference with 8x the bandwidth
AI inference just plays by different rules
Intel bets the farm on AI inference to drag CPU back to the top table
Intel backs SambaNova's $350M bid to challenge GPUs in AI inference
AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say
Microsoft announces powerful new chip for AI inference
Analog optical computer for AI inference and combinatorial optimization
Alibaba looks to end reliance on Nvidia for AI inference
A closer look at Dynamo, Nvidia's 'operating system' for AI inference
OpenInfer raises $8M for AI inference at the edge
How Cerebras is breaking the GPU bottleneck on AI inference
Groq secures $640M to supercharge AI inference with next-gen LPUs
Meta engineer: Only two nuclear power plants needed to fuel AI inference next year