The v0.4.0 release of the ONNX Runtime WebGPU Plugin EP brings kernel optimizations, expanded operator support, and reliability fixes, including fused activations for Conv/MatMul, int8 KV cache quantization, and Linux AArch64 packages.
ONNX Runtime 1.30.0 expands CUDA generative AI with INT4 paged KV caches and speculative decoding, adds Go bindings, and gates CPU FP16 Gemm and MatMul on hardware acceleration with FP32 fallback.
ONNX Runtime 1.29.0 brings PagedAttention with quantized KV cache, NVFP4 QMoE for CUDA, and WebGPU EP expansions, while deprecating WebGL and JSEP in onnxruntime-web. Security fixes cover path traversal and operator validation.
We count visits on the server, cookie-free. You can also let this browser tell us how long you read, how far you scroll and which links you follow. It stays with us.