Home
Shorts

Group Query Attention

8:13

Variants of Multi-head attention: Multi-query (MQA) and Grouped-query attention (GQA)

Machine Learning Studio

6.1K views

7:24

Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped Query Attention (GQA) Explained

DataMListic

3.4K views

1:10:55

LLaMA explained: KV-Cache, Rotary Positional Embedding, RMS Norm, Grouped Query Attention, SwiGLU

Umar Jamil

59K views

5:34

Attention mechanism: Overview

Google Cloud Tech

138K views

1:21

Transformer Architecture: Fast Attention, Rotary Positional Embeddings, and Multi-Query Attention

Rajistics - data science, AI, and machine learning

733 views

40:54

Deep dive - Better Attention layers for Transformer models

Julien Simon

9.3K views

15:51

LLM Jargons Explained: Part 2 - Multi Query & Group Query Attent

Machine Learning Made Simple

397 views

11:27

Mistral Spelled Out: Grouped Query Attention : Part 8

Aritra Sen

195 views

3:04:11

Coding LLaMA 2 from scratch in PyTorch - KV Cache, Grouped Query Attention, Rotary PE, RMSNorm

Umar Jamil

35K views

0:53

Multi-Head Attention (MHA), Multi-Query Attention (MQA), Grouped-Query Attention (GQA) #transformers

DataMListic

470 views

20:30

Multi-Head vs Grouped Query Attention. Claude AI, Llama-3, Gemma are choosing speed over quality?

Chris Hay

1.1K views

10:13

Key Query Value Attention Explained

Alex-AI

18K views

0:48

Multi-Head Attention vs Group Query Attention in AI Models

Chris Hay

198 views

1:40

Multi-Query vs Multi-Head Attention

Super Data Science: ML & AI Podcast with Jon Krohn

141 views

8:38

Transformers: The best idea in AI | Andrej Karpathy and Lex Fridman

Lex Clips

380K views

58:04

Attention is all you need (Transformer) - Model explanation (including math), Inference and Training

Umar Jamil

369K views

1:26:21

Mistral / Mixtral Explained: Sliding Window Attention, Sparse Mixture of Experts, Rolling Buffer

Umar Jamil

26K views

1:22:38

CS480/680 Lecture 19: Attention and Transformer Networks

Pascal Poupart

345K views

59:33

LambdaNetworks: Modeling long-range Interactions without Attention (Paper Explained)

Yannic Kilcher

48K views

12:29

Power Query - Alternate Group By Strategies

BCTI

3.6K views