mlx gemv_wide bf16 small-M kernel in mlx 0.32.1
Parent: Mac local LLMs: Speculative decoding and MTP · Published reference · snapshot 2026-10-05
↓ Facts as markdownall context files
Already covered: `gemv_wide` (PR 3888, "metal: add gemv_wide for fp16/bf16 matmuls of a few rows") is listed in the MLX 0.32.1 release notes, and its eligibility, routing and measured speedups are recorded in mlx-gemv-wide-bf16-fp16-few-row-matmul-kernel-pr.md.
These notes link each claim to its source. A source may be a research report hosted on this site rather than the primary document. A published reference means the content is available; it does not certify independent review or accuracy.Read the editorial policy and follow the sources before relying on a claim.
Facts
- Already covered: `gemv_wide` (PR 3888, "metal: add gemv_wide for fp16/bf16 matmuls of a few rows") is listed in the MLX 0.32.1 release notes, and its eligibility, routing and measured speedups are recorded in mlx-gemv-wide-bf16-fp16-few-row-matmul-kernel-pr.md. [source]
Children
- No children recorded.