GQA (shapes)
Attention by shapes · 11 of 11
The idea
Section titled “The idea”Two groups here: each has one full head and two sharers. KV sets equal the group count — not 1, not H.
Where the story continues
Section titled “Where the story continues”GQA owns the memory-bill / quality compromise. This page is the live shape diagram.