MLX v0.32.4 adds 1-bit quantization, stft, and Python 3.15 support
MLX v0.32.4 brings 1-bit affine quantization on Metal, new FFT functions, Python 3.15 support, and dozens of kernel and correctness fixes for inference workloads.
Read the article ↗All articles
Find reporting and practical references by subject.
OllamaInferenceNewsOllama v0.40.4-rc1 adds Kev decision scoring to MLX backend
Ollama's release candidate v0.40.4-rc1 introduces Kev decision scoring to the MLX backend, loading Kev models with FP32 decision heads and release metadata, plus System One scoring with shared-state caching.
Read the article ↗
MLX v0.32.0 adds CUDA JIT kernel caching, Metal zero-copy DLPack, and Windows JIT support
MLX v0.32.0 brings CUDA JIT-compiled quantized matmul kernels with caching, Metal zero-copy DLPack sharing, Windows JIT compiler support, and a batch of correctness fixes across CPU, Metal, and CUDA backends.
Read the article ↗