llama.cpp's Metal 4 fast path now ships as two metallibs, and on iPhone the second one is the whole point
The silent tensor-API probe failure was a shader-compiler default. The fix disables the fast path for precompiled libraries — which is everything on iOS — so the xcframework now ships a second metallib gated on SDK 26.
Apple's 4.3x is a prefill number, and one init-time check decides whether you get it
The M5 Ultra Mac Studio landed this week. A Metal 4 capability check that fails silently can cost you 2–3x of its headline gain — and generation speed looks fine either way.
Speculative decoding is not a free 2x on Apple Silicon, and MoE makes it worse
Liquid AI shipped an on-device result with 85% draft acceptance and a 1.04x speedup. Why sparse experts and unified memory break the assumption that acceptance rate predicts throughput.
ExecuTorch's Apple Silicon path is MLX and hand-written Metal. Not Core ML, not MPS.
Meta's flagship on-device model demo routes around both delegates Apple ships in the OS. What that means if you're choosing a backend today, plus the K-quant repacking trick worth stealing.
ONNX Runtime just deprecated WebGL and JSEP. Read the changelog, not the WebNN press release.
Two browser-ML milestones landed a day apart and point in opposite directions. Thirty WebGPU changes against one WebNN line — including PagedAttention in a browser.
Production Blueprint
CI/CD pipeline configuration templates engineered for rapid deployment of isolated environments.