u/RelevantEmergency707

r/LocalLLM r/deeplearning r/programming r/LLMDevs r/OpenSourceeAI r/kubernetes r/LocalAIServers r/Vllm

Faster LLM Inference with Speculative Decoding

▲ 8 r/LocalAIServers+3 crossposts

Faster LLM Inference with Speculative Decoding

u/RelevantEmergency707 — 6 days ago

▲ 57 r/Vllm+3 crossposts

llm-d: Distributed LLM Inference on Kubernetes

u/RelevantEmergency707 — 6 days ago

▲ 6 r/deeplearning

How Reasoning LLMs Work (RL, Thinking Tags & Budgets Explained)

u/RelevantEmergency707 — 2 months ago

▲ 4 r/OpenSourceeAI+3 crossposts

LLM Quantization

u/RelevantEmergency707 — 2 months ago

▲ 1 r/LLMDevs

Mixture of Experts (MoEs)

u/RelevantEmergency707 — 3 months ago