The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer ...
dbta

Predibase Inference Engine Offers a Cost Effective, Scalable Serving Stack for Specialized AI Models

Predibase, the developer platform for productionizing open source AI, is debuting the Predibase Inference Engine, a comprehensive solution for deploying fine-tuned small language models (SLMs) quickly ...
insideHPC

Crusoe Launches Managed Inference AI

SAN FRANCISCO – Nov 20, 2025 – Crusoe, a vertically integrated AI infrastructure provider, today announced the general availability of Crusoe Managed Inference, a service designed to run model ...
EDN

NTT develops AI inference chip for 4K video processing

At its Upgrade 2025 annual research and innovation summit, NTT Corporation (NTT) unveiled an AI inference large-scale integration (LSI) for the real-time processing of ultra-high-definition (UHD) ...