Models & Research
Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed Attention
After a short family break, I am excited to be back and catching up on a busy few weeks of open-weight LLM releases.
Daily Brief · Archive
Saturday, May 16, 2026
Every story published that day — lead first, then grouped by section.
Models & Research
Models & Research
Recent Developments in LLM Architectures: KV Sharing, mHC, and Compressed Attention
After a short family break, I am excited to be back and catching up on a busy few weeks of open-weight LLM releases.