AI inference

Read news on AI inference with our app.

Read more in the app

AI inference startup Fal doubles its valuation to $16B as demand surges

Darkbloom, which allowed Mac users to rent out their GPUs for AI inference, warns of low payouts

AMD and Intel will work together to create a single PyTorch code path for AI inference on CPUs

AI inference is running into a memory bottleneck. Huawei wants to tackle it with OceanStor M900

Cohere's Model Vault now encrypts AI inference so even Cohere cannot see enterprise customers' data

Startups want to rent your idle gaming PC for AI tasks — Startups pitch an 'Airbnb for AI inference,' but profitability remains unproven

Hot Chips 2026: Samsung makes LPDDR5X smart with logic unit in memory — LPDDR5X-PIM is 3.01x faster than LPDDR5X in AI inference with 8x the bandwidth

AI inference just plays by different rules

Intel bets the farm on AI inference to drag CPU back to the top table

Intel backs SambaNova's $350M bid to challenge GPUs in AI inference

AI inference startup Modal Labs in talks to raise at $2.5B valuation, sources say

Microsoft announces powerful new chip for AI inference

Analog optical computer for AI inference and combinatorial optimization

Alibaba looks to end reliance on Nvidia for AI inference

Alibaba looks to end reliance on Nvidia for AI inference

A closer look at Dynamo, Nvidia's 'operating system' for AI inference

OpenInfer raises $8M for AI inference at the edge

How Cerebras is breaking the GPU bottleneck on AI inference

Groq secures $640M to supercharge AI inference with next-gen LPUs

Meta engineer: Only two nuclear power plants needed to fuel AI inference next year