Research library
Reports about Inference
Published research tagged with Inference. Search within this topic or clear it to explore the full library.
Semantic Router for LLM Apps: Embeddings and Intent Routing
3.9Kstars
Rapid-MLX for Coding Agents: Apple Silicon Inference
4Kstarskvcached GPU Memory Sharing: How Elastic KV Caching Works
1.5Kstars
Slotstream Explained: Running MoE Models on a Mac
412stars
GPUStack for Multi-GPU Inference: Server and Worker Roles
5.8KstarsMilvus Explained: Vector Search and Storage Separation
46.1KstarsInferenceX Explained: Comparing LLM Inference Benchmarks
1.7Kstars
KServe Explained: Choosing a Kubernetes Serving Mode
5.9Kstars
OpenVINO Deployment Overview: Conversion and Device Support
10.8KstarsBifrost AI Gateway Explained: Latency and Fallbacks
7.7Kstars
Spice Explained: Federated Queries vs Local Acceleration
3.1Kstars