Phison Rescales Local AI Inferencing with Flash Memory Expansion

Phison Electronics (8299TT), a global leader in NAND flash controllers and storage solutions, today announced its GTC ...

What is inference? Explaining the massive new shift in AI computing

The focus of artificial-intelligence spending has gone from training models to using them. Here’s how to understand the ...
insideHPC

In-Memory Computing Could Be an AI Inference Breakthrough

[CONTRIBUTED THOUGHT PIECE] Generative AI is unlocking incredible business opportunities for efficiency, but we still face a formidable challenge undermining widespread adoption: the exorbitant cost ...

New memory architecture targets AI inference bottlenecks

Lightbits Labs Ltd. today is introducing a new architecture aimed at addressing one of the most stubborn bottlenecks in large-scale artificial intelligence inference: the growing mismatch between the ...

Nvidia GTC 2026: Jensen Huang’s Groq ‘Mellanox moment’ and the inference land grab

Ahead of Nvidia Corp.’s GTC 2026 this week, we reiterate our thesis that the center of gravity in artificial intelligence is ...
Semiconductor Engineering

GDDR6 Memory Enables High-Performance AI/ML Inference

A rapid rise in the size and sophistication of inference models has necessitated increasingly powerful hardware deployed at the network edge and in endpoint devices. To keep these inference processors ...
Semiconductor Engineering

AI Inference Memory System Tradeoffs

When companies describe their AI inference chip they typically give TOPS but don’t talk about their memory system, which is equally important. What is TOPS? It means Trillions or Tera Operations per ...
Business Wire

Credo Unveils Industry’s First Memory Fanout Gearbox for Scalable, High-Bandwidth AI Inference

SAN JOSE, Calif.--(BUSINESS WIRE)--Credo Technology Group Holding Ltd (Credo) (NASDAQ: CRDO), an innovator in providing secure, high-speed connectivity solutions that deliver improved reliability and ...
Yahoo Finance

NVIDIA BlueField-4 Powers New Class of AI-Native Storage Infrastructure for the Next Frontier of AI

NVIDIA Inference Context Memory Storage Platform is a new class of AI-native storage infrastructure built for long-context-processing. · GlobeNewswire Inc. NVIDIA BlueField-4 powers NVIDIA Inference ...

NVIDIA Enters Production With Dynamo, the Broadly Adopted Inference Operating System for AI Factories

NVIDIA Dynamo 1.0 provides a production-grade, open source foundation for inference at scale.Dynamo and NVIDIA TensorRT-LLM ...

Nvidia shrinks LLM memory 20x without changing model weights

Nvidia's KV Cache Transform Coding (KVTC) compresses LLM key-value cache by 20x without model changes, cutting GPU memory costs and time-to-first-token by up to 8x for multi-turn AI applications.

AI’s memory chip shortage is quietly taxing the entire economy

AI's insatiable appetite for memory chips is crowding out all other buyers — and the consequences will ripple through every industry and household.