RTX 50 Prices Jump 19% and the 5070 Ti Is Gone — Buy Now or Wait
NVIDIA cut RTX 50 supply by 20% and sidelined the 5070 Ti. Street prices are up 19%. Here's how it changes your local AI build.
#homelab
11 posts
DiffusionGemma Puts 1000+ tok/s on an RTX 5090
Google's open 26B diffusion model hits 700+ tok/s on consumer GPUs with day-zero vLLM support. Here's what the bidirectional architecture changes for local inference.
Apple Silicon Just Cracked the 150B Wall at 56 tok/s
Rapid-MLX's new engine optimizations push DeepSeek V4 Flash 158B-A13B to 56 tok/s on a Mac. Here are the exact numbers and the tradeoffs.
Your 12GB MTP Throughput Just Jumped 23%
A community llama.cpp fork squeezes 110 tok/s out of Qwen3.6-35B-A3B MTP on a 12GB card. Here are the exact flags and the VRAM trick to make it fit.
Your Local Throughput Just Doubled (With No Accuracy Tax)
Multi-token prediction is merged into llama.cpp, delivering 1.4–2.2x throughput on Qwen3.6 with zero accuracy loss.
MTP in llama.cpp Adds 24–33% Throughput on Qwen3
llama.cpp merged Multi-Token Prediction for Qwen3. Community benchmarks show 38→47 tok/s on RTX 3090 and 63→84 tok/s on RTX 5090 — no new hardware needed.
AMD GPUs Are Getting 10% Pricier — Here's the Full Picture
AMD has notified its supply chain of a ~10% GPU price increase driven by a DRAM shortage. DRAM contract prices rose 90–95% QoQ in Q1 2026. Here's what to buy, hold, or skip.
DFlash Decode Collapses at Long Output. MTP Doesn't.
One llama.cpp flag—--spec-draft-p-min 0.75—turns MTP from a dud into a decode speed that holds flat across output lengths where DFlash falls apart.
DDR5 Tripled Since October — Buy Nothing Yet
DRAM and NAND prices have surged 90–130% since late 2025. A Samsung factory walkout and HBM reallocation mean the crunch won't clear before late 2027 at earliest.
One llama.cpp Flag Turns MTP From Dead Weight to 68% Faster
The --spec-draft-p-min filter in llama.cpp PR #22397 rescues MTP for Qwen3.6-27B: 48.9 tok/s vs 29 tok/s at 2000 tokens on a 24GB card.
Running Qwen3.6-27B Locally: Hardware, Quantization, and What Actually Works
A practical guide to running Qwen3.6-27B on consumer hardware in 2026 — memory requirements per quant level, recommended runners, and the MTP trick that doubles your tokens per second.